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SECTION I 


INTRODUCTION AND OVERALL SUMMARY 


Instrument flying is basically a task of interpreting a set of needles 
and numbers to determine answers to the questions "Where am I?" and ’'Where 
am I going?" Under normal circumstances a trained pilot can accomplish 
this task with a fair degree of precision and at a reasonable workload 
level. However, in a high workload and/or a high stress situation, other 
factors are competing for the pilot’s attention, thereby making it diffi- 
cTolt or impossible for the pilot to maintain a clear mental picture of his 
position and direction of flight. The pilot is then said to be "behind the 
airplane," i.e., things are happening so fast that by the time he reacts 
it may be too late. 

A moving map display eliminates the necessity for the pilot to convert 
images of needles and ntmibers into a two-dimensional image of his geographic 
position and direction of flight. Thus, the moving map display shoiild pro- 
vide a significant reduction in that particular cognitive workload. The 
pilot can now tell at a glance his complete horizontal status in terms of: 
l) position; 2) direction of flight; and 5) rate of closure on specific fixes. 
The desirability of such a map display is therefore not really in quesbion; 
it is definitely better than a display of relative bearings and course devia- 
tion on needles. More appropriate (and subtle) questions are "How much 
better?" and "Under what conditions is the moving map display worth the 
potential additional cost?" 

The investigation reported here has been designed to provide sane 
answers to the foregoing questions by making a systematic comparison of an 
electronic moving map display and an electromechanical Horizontal Situation 
Indicator (HSI) used in conjunction with other instruments (EADI, altimeter, 
airspeed indicator, etc.) in the NASA-Ames digital avionics system for guid- 
ance and control of powered-lift, short-haul aircraft. This research forms 
one part of the joint DOT /NASA STOL Operating Systems Experiments Program. 
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The overall objective of the joint DOT/NASA STOL Operating Systems 
Experiments Program is to provide data to aid the design of terminal area 
guidance, navigation and control systems, and the definition of operational 
procedures for powered- lift and light wing- loading, short-haul aircraft 
under instrument flight rules (IFR). As a first step in this program, 
experimental digital automatic and flight director guidance and control 
systems have been developed for the MSA Augmentor Wing powered-lift short- 
haul aircraft by ^erry Flight Systems (under MSA contract). This system, 
called STOIAM), is based on the application of current CTOL system tech- 
niques and displays to the experimental short-haul aircraft. 

Two of the primary displays used in the system are an Electronic Atti- 
tude Director Indicator (EADI) and a standard Horizontal Situation Indicator 
(HSI). In addition, this digital system has a computer driven, cathode I'ajr 
instrument called the Muitifunction Displajr^ or MFD, which displays the air- 
craft position and predicted motion on a moving map of the area. Thus, in 
STOLAM) the MFD is the moving map display. Also displayed are o'sher status 
data including heading, altitude, raw navaid data, and reference flight paths. 

Operation of the STOLAND system and its primary displays is described 
in Ref. 1. A review of the display content and function of the MED, HSI, 
and EADI from an operational point of view is presented in Section II of 
this report. At the conclusion of Section II there is a concise summary of 
the review of the display content and function of the primary STOLAND dis- 
plays. 

Section III of this report then describes an experimental simulation 
of STOLAND operation designed to gather data for a systematic comparison of 
the MFD and HSI from an operational point of view under simulated instrument 
flight rules. The operational flight phases of interest in this simulation 
are: l) the terminal routine within a 56 km (50 nm) radius of Grows Landing 

ALF, Colusa County, Californiaj 2) the landing approach down to the minimum, 
decision altitude for ’'see-to-land" visibility conditions; and 5) the missed 
approach procedure. 

Besides the usual sequence of straight course segments at constant alti- 
tude interspersed among turns and descents and the occasional holding pattern 
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■within the terminal area, a STOL transport , .on' nearly every flight, will 
typically he req'uired to slow do'wn and convert to operation below the speed 
for minimum thrust (or power) required (''backside operation" for short); 
and to negotiate curved courses and decelerating steep precision approaches 
do'wn to instrument minima followed by a short field landing. Each of these 
segments of the approach course and path can keep both pilots fully occu- 
pied even when decelerations, descents, or turns are made separately under 
XFR. However, when some STOL segments may involve combined maneuvers, a 
significant in^rovement in the pilot/vehicle system will be required to^ 
achieve such instrument operations routinely and still maintain a level of 
safety consistent with present standards. 

The purpose of this research is to investigate the use which pilots 
make of the MF'D in conjunction with other displays from en route to the ter- 
minal area including the approach and landing flight phases. Various features 
of each of the primary ST0LAJ3D displays, the MED, HSI, and EA.DI, are used in 
the three phases of flight mentioned above when the STOLAHD system is oper- 
ated in each of three ways : a) flown in the fully automatic mode with the 

pilot(s) in a monitoring role; b) flown manually using flight director guid- 
ance to reduce workload and task requirements to an acceptable level; or 
c) flown manually using raw instrument situation data. Eye -point -of -regard 
and workload measurements, coupled with task performance measurements, were 
employed in the experimental program to determine the pilots ’ use of the MED 
in conjunction with the other displays. The results of the experiments are 
described in detail in Section III. A concise s-uramaiy of the results of the 
experimental comparison of the MFD and the HSI together with the conclusions 
drawn from the data is presented at the end of Section III. 

There are then not only indications of the utility of the MED as a sup- 
plement to the HSI but also some suggestions for improvements to the informa- 
tion content and format of all of the primary STOLAND displays. The conclu- 
sions from the investigation appear in Section IV, and the suggestions are 
presented at the end of Appendix; D. 

Supporting references and appendices follow Section IV at the end of the 
report . 


SECTION II 


mvmf OF CONTENT AND FUNCTION OF 
THE STOLAND DISPLAYS 

A. PURPOSE 

Operation of the STOLAND system and its primary displays is descrihed 
in Ref. 1. Excerpts from this document have heen reproduced here in Appen- 
dix A to illustrate the displays. 

The purpose of this initial review is to verify that the presentation 
of essential feedbacks for guidance, navigation, control and monitoring, 
at each level of pilot participation, is in accord with the best display 
design practice from the viewpoints of pilot confidence and acceptance With 
due consideration for en route and terminal area flight safety and opera- 
tional capability. Among the more crucial q.uestions behind this review are 
those concerning the adeq,uacy of the STOLAND displays (and vehicle flight 
controis), if the pilot be required to take over and complete the short 
approach manually in the event of an automatic system failure. 

As the starting point for the introduction of practical criteria for 
comparative display evaluation, we have turned to recent developments in 
human response theory and pilot/vehicle analysis (Refs. 2-k) as well as to 
the more traditional pilot opinion rating metrics (Ref. 5) • In performing 
this review we shall apply the known relationships between predictable (and 
measurable) properties of pilot behavior in STOLAND control tasks and some 
of the practical cockpit display design parameters listed in Table 1 . Our 
prior experience with STOLAND pilot /vehicle analysis and simulation (Refs. 6-8) 
will provide the necessary foundation for this review . 

B. PREREQUISITES 

To begin with, q,uantitative descriptions of the flight profile, vehicle 
dynamics , piloting tasks and constraints are required. These descriptions 
are already available in Refs, 6-8 based on our prior contributions to the . 


TR- 1072-1 


k 




V. 


TABLE 1 

PREDICTABLE DISPLAY-RELATED PARAMETERS FOR GUIDAITCE, 
NAVIGATION, CORTROL, AND MONITORING BASED 
ON MANUAL CONTROL DISPLAY THEORY 


i 

’< 




Display content, i.e., displayed variables required for negotia- 
ting the flight profile and various tasks. Display content is 
based on the essential feedbacks and inputs for each task, sub- 
ject to the allocation of control functions between the pilot 
and the automatic aids. 

Display reference system, e.g./ coordinates, orientation and 
format 


Preferred combinations of displayed variables for reducing scan- 
ning workload, e.g,, inner and outer loop associations 

Control-and-displayed variable associations required for each task 

Dynamic behavior required of the crewmembers, i.e., piloting 
technique 

Dynamics of the display media and compensation thereof 
Display locations and arrangement for least scanning workload 


Display scale range, resolvable quantum, and angular subtense at 
the flight eye location 

Potential parafoveal appeal of the format 


STOLANB program. Using the material in these references (especially Ref. 6 ), 
we have prei>ared a prospectus for control techniques in Appendix A to this 
report. The prospectus for control techniques helps to establish the essen- 
tial feedbacks. Prom these follow not only sensor and control requirements 
but also the first six predictable display- related parameters in Table 1 . 

The method of developing essential feedbacks is described in Ref. 9 and was 
first applied to control-display design for the short landing approach prob- 
lem in Ref. 10 . 
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The prospectus in Appendix A uses the updated transfer functions and 
dimensional stability and control derivatives from Appendix D in Ref. 6. 

These reflect the latest available aerodynamic data anticipated for the 
Augmentor Wing aircraft. The multiloop coupling numerators used here in 
Appendix A are computed without the SAS so as to provide a more critical 
appraisal of manual control techniques and STOIAWD displays, if the pilot 
should be required to take over and complete the short approach in the 
event of an automatic system failure. 

The prospectus for control techniques necessarily depends on the flight 
profile, the dynamics and the controls of the Augmentor Wing Jet STOL Research 
Aircraft (AWJSRA or C-8M) designated for the present stiidy of STOLAND dis- 
plays. Therefore, this review of the content and function of the MRD, HSI, 
and EADI represents a further extension of the earlier cited work based on 
the same aircraft. 

The AWJSRA presently being flown at HASA-Ames Research Center utilizes 
a combination of blown flaps and thrust vector control for lift augmentation. 
Reference to the "nozzle" control in this report designates the hot thrust 
vector control on the AWJSRA. Other flight and propulsion controls are con- 
ventional, viz. , flap angle for lift augmentation, elevator for pitching 
moment control, aileron for rolling moment controJ., rudder for yawing moment 
control and turn coordination, and throttle for thrust magnitude control. 

C. vminni-CEM)Era design REQUIim«S (Rrom Ref. 

During en route phases of flight the best cruising speed of the AWJSRA 
is 82 m/s (160 kt) (IAS) at the altitude assigned by Air Traffic Control. 

This speed is reduced to '’(2 m/s ( 1 4o kt ) on entering the terminal area until 
conversion to the approach speed, and 46 m/s (90 kt ) is used for negotiating 
curved segments or holding patterns . Conversion from l4o kt to 90 kt is 
usually accomplished during straight and level flight to reduce the pilot 
workload associated with combined maneuvers and deceleration. While at 90 kt, 
the glide slope is usually acquired during wings level flight, although a 
descending turn may precede and follow acquisition of the glide slope. During 
the last stage of descent on the glide slope the final turning phase of the 
approach is initiated. About halfway around the turn the deceleration from 
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46 m/s (90 kt) to 31 m/s (60 kt) is initiated and is completed prior to com- > 

pleting the turn. The final approach is on a straight path. Deceleration 
and speed control are provided hy the pilot. The trim management system and 
speed stability augmentation system (SAS) described in Ref. 8, but not yet 
implemented, are designed so as to reduce pilot workload. 

There are several vehicle-centered design requirements that shoiald be 
discussed at the outset. First, glide slope capture and subsequent track- 
ing must be at or below 48 m/s (94 kt). Because of flap placards, drag 
capability is not sufficient to decelerate the vehicle on a 7*5 deg glide 
slope in the presence of a tailwind when the speed is higher than 94 kt 
(Ref. 7). 

A second design requirement is that the vehicle control technique be 
properly altered as a function of frontside/backside flight conditions. When 
the vehicle is on the frontside of the thrust-required curve, i.e. , V > 44 m/s 
(85 ikfc), the conventional technique of flight path control via elevator is 
preferred. Conventional flight path/attitude response times are proportional 
to speedj and at the higher speeds, larger path mode bandwidths can be achieved 
with attitude (through elevator) than with thrust or nozzle. Also, at these 
speeds the nozzles and/or thrust do not have sufficient control power to pro- 
vide an adequate direct lift control (DLC) capability because the nozzle trim 
angle is less than 30 deg. At lower speeds where the vehicle is flying on the 
backside of the thrust-required curve, the STOL technique of controlling flight 
path with thrust and airspeed with attitude is preferred for reasons converse 
to those cited above for conventional control. The STOL technique avoids any 
flight path instability because of backs idedness. As a matter of fact, with 
the trimmed nozzles aligned nearly vertical, the only effective method of 
controlling speed is with attitude . Each of the above points is illustrated 
by the prospectus for control techniques at 46 m/s (90 kt) and 31 l*i/s (60 kt) 
in Appendix A. 

A last vehicle-centered design requirement is for glide slope interception 
and acquisition at any speed from 60 to 90 kt. The normal procedure to expe- ■ 

dite the approach and keep noise levels down is to decelerate to 90 kt while 
straight and level, intercept the glide slope, and slow to 60 kt when on the ‘ if 

glide slope. However, the pilot should also be able to slow to 60 kt while I 

7 ' ' ' . ' :■ ■ ■■ , ■ " . 
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straight and level and then intercept the glide slope. This situation might 
he necessary for approaches in a tailwind or for maintaining approach spacing. 

This concludes our suitmary of vehicle-centered design requirements from 
Ref. 7. Next we shall summarize some pilot- and system-performance-centered 
requirements which affect the prospectus before resuming our review of the 
content and function of the primary STOLAND displays in the light of the 
prospectus of essential displayed feedbacks. 

D. PILOT PERFORMANCE-CENTERED DESICW REQUIREMENTS 



Establishing the essential feedbacks represents the first step in the 
control- display optimization procedare — optimization of guidance and 
flight control topology . Foremost among pilot- centered design requirements, 
the topological prospectus of essential feedbacks must remedy aircraft 
handling quality deficiencies. Otherwise, the pilot must compensate for 
any dynamic deficiencies of the aircraft by appropriate adjustments of his 
dynamic properties, (in this context the "aircraft" includes the displays 
and controls.) There is a cost for this adjustment -— in workload- induced 
stress, in conGentration of pilot faculties, and in reduced potential for 
coping with the unexpected. This cost can also be traded for the cost of 
automatic control. Whereas an effective man/machine split can definitely 
solve stability problems by machine-aided stability augmentation, machine- 
aided control (in the guidance sense) will be effective only to the extent 
that the display- and- flight- control system design recognizes: a) the ^^^^ ^ 

pilot's supervisory "trim and control" authority; b) his desire to parti- 
cipate at not more than a saturated work level throughout the flying task; 
and c) the necessity that he have the ability and opportunity to make key 
decisions requiring judgment of progress in the precision en route, terminal 
area, approach and landing tasks. 

E. SISTEM PERFORMANCE-CENTERTD DESIGN REQUIREMENTS 

Foremost among system performance- centered design requirements which 
affect the topological prospectus throughout the fli^t profile, the flight 
control system must provide; 
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• Acceptable margins of stability to establish and maintain 
specified equilibrium states of vehicle motion^ i.e., 
operating points. 

• Desired responses to specified inputs, both deterministic 
.and stochastic. 

i ; 1 ■ 

•| Suppression of the effects of undesired inputs, both deter- 
' ministic and stochastic. 

• Suppression of the effects of pilot, vehicle and component 
variations and \mcertainties, i.e., least sensitivity of 
stability, disturbance regulation and command- following 
performance to variations in flight conditions, gain, 
equalization, time delay, unattended operation, noise 
sources, sensor location or orientation, control surface 
loads, and authority limitations. 

Essential feedbacks derive from all of the foregoing requirements. 

F. ESSENTIAL DISPLAYED FEEDBACKS 

One of the most concise graphic ways to summarize the essential feedbacks 
is by means of a block diagram for each of the flight segments involving a 
particular piloting technique. Fortunately in the case of the AWJSRA, sym- 
metric motions are uncoupled from asymmetric motions, and we can separately 
consider: a) the longitudinal- vertical control techniques j and b) the lateral' 
directional techniques. Therefore, we have prepared several block diagrams 
of essential feedbacks appropriate, for a particular control technique. These 
essential feedbacks constitute the prerequisites for the content and func- 
tion of the primary guidance and control displays, the EADI, HSI, and MFD. 
Throughout and following a discussion of the block diagrams next, we shall 
subsequently proceed to consider each primary STOLAND display described in 
Ref, 1 and illustrated in Appendix A together with whether or not it pro- 
vides the essential feedbacks and other attributes from Table 1 in ways 
which favor the pilot -centered requirements. 


1 . 


Longitudinal-Vertical Control Techniques 


The longitudinal-vertical control techniques can he divided, for conveni- 
ence, into two groups based on the phases of flight for which the techniques 
are appropriate, viz,; a) en route and terminal area flight j and b) final 
approach on the glide slope. We shall present examples of each in turn. ^ 

a. En Route and Terminal Area Flight 

At constant altitude . Figure 1 presents a bloclc diagram of essential 
displayed feedbacks together with compensatory piloting techniques for longi- 
tudinal and vertical flight control en route and in the terminal areas under 
IFR at a reference airspeed, Vj., above that for minimum thrust required (i.e., 
for frontside operation) and at a reference altitude, hj.. All of the pilot's 
trim control functions are based on indicated airspeed. Examples of some 
trim configuration management schedules are given in Refs. 6 and 8. Cruising 
airspeed regulation with respect to Vr is accomplished with the throttle 
based on airspeed error. Decelerating airspeed control is accomplished with 
the nozzle, again based on airspeed error. Although the numerical airspeed 
display on the EA.DI (Appendix A, Fig. A-1) represents an essential feedback 
which is always available to the pilot for the purpose of monitoring and 
trim management, the numerical form of display has no parafoveal appeal and 
has been shown in Ref. 11 to be unsuitable for the purpose of tracking. How- 
ever, the airspeed error tracking display on the EADI is available only when 
the STOLAWD ’’Flight Director” or ’’Automatic” modes are operating (Ref. 1), 

Thus, when the pilot is using raw situation data for flight control, he 
should derive airspeed tracking error with respect to the reference ”bug” 
on his airspeed indicator to the left of the EADI, which definitely requires 
an extra scan transition and fixation away from the EADI (Appendix A, Fig, A-4), 

This will tend to corrupt the pilot 's perceived airspeed error signal, u^, 
with relatively more internally generated scanning noise than would the air- 
speed error tracking display on the EADI, which offers at least moderate para- 
foveal appeal. 

Cruising altitude regulation with respect to hr is accomplished through 
pitch attitude regulation with the elevator using the EADI (Appendix A, 
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Piloting Techniques for Longitudinal and Vertical Flight Control of the 
AWJSRA En Route and in the Terminal Area Under IFR at a Reference Airspeed, 
Vj.^ Above that for Minimum Thrust Required and at a Reference Altitude, hj. 
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Fig. A“l). The commanded or reference altitude, hr, is displayed numeri- 
cally only in the list of "next waypoint data" in the lower left corner of 
the MFD. The barometric altitude is displayed in the upper left corner of 
the MFD (Appendix A, Fig. A-5). The altitude error display on the EADI is 
provided by the normal displacement of th6 path deviation "window" with 
respect to the case*- fixed airplane symbol which serves also as the point 
of reference for pitch attitude. Thus, inner and outer loop tracking dis- 
plays appear well coordinated from the pilot’s ■’/iewpoint, and both may even 
be perceived in the same fixation. In addition, there is an altitude error 
display provided (for monitoring) on the HSI by the vertical deviation indi- 
cator at the right edge ( labeled "glide slope scale and pointer" in Appen- 
dix A, Fig. A-2). It also, however, provides altitude error with respect to 
any reference flight path. Besides the "ILS" and "MLS" modes, these altitude 
error displays on the EADI and HSI are available for en route and terminal 
area flight only in the "Reference Flight Path" mode when the path has been 
captured laterally. Verifying that the numerical value of altitude is correct 
requires an extra scan transition and fixation away from the EADI either to 
the barometric altimeter at the left of the EADI (Appendix A, Fig. A-k) or to 
the numerical barometric altitude display on the Opposite side at the top of 
the MFD (Appendix A, Fig. A-5). 

Vertical path damping is provided by the vertical speed (h) or flight 
path angle (7) feedback. (Recall that for small angles, 7 = h/Vo, where Vq 
is the trimmed speed, so that h and 7 are dynamically equivalent, although 
the sensitivity of : 7 to changes in h will be inversely proportional to the 
trimmed speed. ) The EADI provides 7 and its inner loop associate, pitch 
attitude, 0, iu the foim of an ideal superimposed multiloop tracking display 
commensurate with the pitch angle scale and compatible with the motion of the 
path deviation window in the manner of a "state and rate" combination (Ref. 12). 
The whole value of . either h or 7 can be selected for display in numerical form 
near the top of the EADI, but this is not in a suitable form for the purpose 
of tracking control (Ref. 11). It is, however, acceptable for verifying steady 
values of vertical Speed or angle in climbing and descending flight. This we 
shall discuss subsequently in connection with Fig. 2. 
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The signals within the pilot labeled hr and 0r in Fig, 1 contain both 
deteiministic and random coii^nents. The deterministic components repre- 
sent the trimmed values of vertical speed (or flight path angle) and pitch 
attitude, respectively, remembered by the pilot. The random components 
represent Internally generated scanning noise. If the piJ.ot chooses to scan 
the conventional instantaneous vertical speed indicator (IVSI) at the left 
of the altimeter in closing his vertical speed feedback loop, he will incur 
a relatively greater penalty in the form of scanning noise than if he uses 
the EADI to close a flight path angle loop. Given the greater sensitivity 
of the IVSI and its format which is incompatible with the EADI format any- 
way, there is little choice but to locate the IVSI on the instrument panel 
in a peripheral relationship to the altimeter where movements of its rela- 
tively sensitive pointer will be detected by the pilot’s parafoveal vision. 

Climbing and descending en roi,ite and in the terminal area . Figure 2 
presents a block diagram of essential displayed feedbacks together with com- 
pensatory piloting techniques for longitudinal and vertical flight control 
en route and in the terminal area under IFR at a reference airspeed, Vr, above 
that for minimum thrust required and climbing or descending along a reference 
flight path aaigle, 7j,. On the EADI the reference path angle is defined by the 
pitch scale (although there is no cursor to identify the reference value) so 
that the angle itself has to be remembered by the pilot or verified by scan- 
ning to the numerical flight path angle reference display at the extreme right 
of the MPD (Appendix A, Pig. A-i^■), Since ’’frontside” operation is presumed, 
vertical flight path regulation in Pig. 2 is accon^lished through pitch atti- 
tude regulation with the elevator, and speed regulation is with the throttle 
as described in Fig. 1 . The EADI content and format are ideal. The decelera- 
tion and trim functions are identical to those already described in connection 
With Fig.. 1. \ ; ^\V: 

Operation of the "FP Acceleration” symbol on the EADI (Appendix A, Fig. A-1 ) 
is not described in the text of Ref. 1 , so we can only speculate about its 
intended purpose. One possibility is to present + 0 to the pilot as an inner 
loop signal to provide the necessary lead equalization for regulating 7. In 
such a role, the perturbed pitch attitude 0 is a surrogate for at fre- 

quencies above the inverse flight path time constant, 1 /T02 (see below) . That 



IncJiccitec Air 5p<tccl 

— — — r> i 


p;lo+ s Throttle ‘^T+ .. 


Trim Pu net ion 


Trir>v 

('^ruiseJ 




Pilot 


j An': t^eexi, 

\ iz.rri'^r 


(Decelerated' 


PiVot's 


Tr'fiyi 

Punctioii 


■ Pdo+j: 

Flop 


Func-t loi) 


G Msts 


I A\rcra^t I 


i * 

I ,Au «+«ti'oni 


PMe»t 

P i 1 0 + V £ ley a '( o*' 
Tri)'rt P"u»vdt©n 


w<-, 1 


Anjie ^ "g ^ y 


P^ifV, 

AwjU 

Rei(erevtce 

orv 

Pi’+cVi 

Soxle^ 

or 

Perspec^we. 

Ru«>m«.w 

Ttiytf^old 


Pilot P\\^ 

Tpy--rv^ 



Pitch Aifj-f u<^g C^spl^ v 
Ver^Xci ninlrt Bn l-b 


Figure 2. Block Diagram of Essential Displayed Feedbacks with Cowpensatory 
Piloting Techniques for Longitudinal and Vertical Flight Control , 
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this is so can he seen from the simple but accurate approximate differen- 
tial equation relating y and e in the low- to mid- frequency region, viz., 

6=7+ Tegf 

where 

VT02 = “-^ + (W%e)^ 

where the stability derivatives, Zw and Mw, and the control power derivatives 
are according to the notation of Ref, 9. Obviously this is a redundant use 
of the "PP Acceleration” sjonbol, because 0 is already presented on the EADI; 
however, it would proAride a canpatible ’’state and rate” format for flight 
path angle control. 

A second possibility is to present potential flight path angle, yp, on 
the ”FP Acceleration” symbol, viz., 

% 

7p = 7o + -^ 

where 7 q is the trimmed flight path angle; a^, the perturbed longitudinal 
acceleration; and g, the gravitational acceleration. Since, in level flight, 

ax = ge + u 

this possibility includes the first with the additional anticipation of 
changes in flight path afforded by changes in speed, u, 

A third possibility for the ”FP Acceleration” symbol has nothing to do 
with flight path acceleration. Instead, the symbol would represent the 
reference path angle, jx, which has otherwise to be remembered by the pilot 
while looking at the EADI. 


b. Final Approach on the Glide Slope 


Before we discuss the essential displayed feedbacks req.uired for tracking 
the glide slope, we shall review several displays on the EABI which are essen- 
tial to the piTLot for monitoring approach progress. These are; 

i i 

• [Radio Altitude 

& 'Minimum Decision Altitude 

• Approach Progress 

The numerical radio altitude display has no parafoveal appeal and there- 
fore requires a scan transition and separate fixation within the field of 
the EADI for perception. Thus the pi3.ot would have to interrupt his track- 
ing fixation on the center of the EADI in order to monitor radio altitude 
visually. This would contribute scanning noise in the pilot's control 
action. Given the range and resolution (Appendix A, Fig. A-1) of radio alti- 
tude presented, the numerical form of display offers the least clutter and 
least chance for misinterpretation, as long as it is not intended for tracking. 

The minimum decision altitude indication is discrete and appears to be 
presented in an excellent location within the EADI for attracting the pilot 's 
attention during precision tracking — in the center of the airplane symbol. 
However, when one reflects on the rationale of the minimum decision altitude, 
presentation only on the EADI would seem insufficient, since the pilot 
approaching his minimum decision altitude will possibly also be scanning 
out of the cocl^pit with his head up. 

The approach progress display employs color coding for a sequence of 
discrete lighted letters arrayed vertically in the right bezel of the EADI. 

The array offers some parafovea,! appeal when the lights change, which may 
be sufficient to attract the, pilot's attention without requiring scanning. 

Next we shall review the essential displayed feedbacks required for 
tracking the glide slope while trimmed for both "frontside" and "backside" 
operation. 

Airspeed above that for minimum thrust required ( "frontside " operation ) . 
Figure 5 presents a block diagram of essential displayed feedbacks together 
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with compensatory piloting techniques for longitudinal and vertical flight 
control on acquiring the glide slope for final approach under IFR at a 
decreasing "frontside” reference airspeed, Vj*. The pilot's deceleration 
and trim functions are identical to those already described in connection 
with Fig. 1 with the addition of a discrete change in the throttle trim 
function at glide slope intercept. For acquiring and tracking the glide 
slope, the glide slope error window display is provided on the EADI by the 
same path deviation window already described in connection with altitude 
control in Fig. 1 . In addition the pilot can monitor glide slope deviation 
on the HSI (Appendix A, Fig. A-2) . Comparison of the lower portions of 
Figs. 1 and 5 devoted to the pilot’s elevator control technique will reveal 
their similarity. The vertical flight path angle display on the EADI pro- 
vides the feedback for path danping, and glide slope displacement regulation 
is accomplished through pitch attitude regulation. Here again, the EADI 
provides dg, 7, and e in the form of an ideal superimposed multiloop tracking 
display as described previously in connection with Fig. 1 . 

Airspeed below that for minimum thrust required . Figure 4 presents a 
block diagram of essential displayed feedbacks together with compensatoiy 
piloting techniques for longitudinal and vertical flight control on acquiring 
the glide slope for final approach under IFR at a decreasing reference air- 
speed, Vj., below that for minimum thrust required (i. e., for "backside" opera- 
tion). Although the deceleration and trim functions remain identical to those 
already discussed in connection with Fig, T, airspeed regulation is now accom- 
plished through the regulation of pitch attitude with elevator, and glide slope 
displacement regulation through flight path angle regulation with throttle, 
subject to monitoring angle of attack for stall margin. Regardless of the 
airspeed, the perspective runway symbol provides a reference for the flight 
path angle display in the "Re ference Flight Path" and the "MODILS " approach 
modes. 

2. Lateral-Directional Control Techniques 

Figure 5 Presents block diagrams of essential displayed feedbacks with 
compensatory and pursuit piloting techniques for lateral-directional flight 
control en route, in the terminal area, and on landing approach under IFR. 
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Figure 5; Block Diagram of Essential Displayed Feedbacks with Gon^ensatory 
and Pursuit Piloting Techniques for Lateral-Directional Flight Control 
En Route, in the Terminal Area, and on Landing Approach Under IFR 






Pursuit piloting techniq.ues involve the opportunities for adopting feedfor- 
ward roll coinniands for flying curved courses in the presence of winds based 
on the explicit graphical plan view of the terminal area situation, the 
required course and the predicted track afforded by the MFD (Appendix A, 

Fig. A-5). In contrast, the HSI (Appendix A, Fig. A- 2) presents only com- 
pensatory information with respect to the desired course and presents polar 
coordinates of position which require mental imaging by the pilot. 

Part a of Fig. 5 shows the displayed feedbacks and control technique for 
selecting and flying a particular heading. The desired heading angle is 
selected and displayed numerically at the extreme right of the MFD (Appendix A, 
Fig. A-k). Corresponding selected heading c\irsors appear on the heading dial 
and tape of the HSI (Appendix A, Fig. A-2) and MFD (Appendix A, Fig. A-J), 
respectively, but there is no heading scale presented on the EADI with its 
inner loop associate, roll attitude. Thus scanning between the EADI and 
either the HSI or MFD is assuredly required in order to turn to and hold a 
selected heading. 


EEC QMMEHDAT ION ; The scanning transition workload presently required 
between the EADI and either the HSI or MFD to fly or monitor a selected 
heading might be reduced in either of two ways : 


a) Present a duplicate of the MFD moving heading tape and selec- 
table "bug" just below the roll scale at the top of the SADI 
in place of the programmable readout. Change the roll scale 
to be movable, i.e,, horizon-oriented, and fix the single roll 
indicator to the case. Coordinate the display of both roll 
scale and heading tape in horizon-oriented "inside-to-outside" 
relationship with respect to the case-fixed index. This pro- 
vides a compatible "state and rate" format with the essential 
content for flying the selected heading with the technique in 


Fig. through aileron control (Ref. 1 2 ). 

b) Transfer the case-fixed roll scale and moving roll indicator to 
the bottom of the EADI and present a duplicate of the MFD moving 
heading tape and "bug" just above or below the roll scale. Coor- 
dinate the case-oriented display of both roll scale and heading 
tape with the ho’rizon-oriented index. This also provides a com- 
patible "state and rate" format with the essential content for 
flying the selected heading with the technique in Fig. 5a through 
aileron control. This offers a distinct advantage over Item a 
(above) in that the moving heading tape can retain the case orien- 


tation familiar to the pilot and similar to the one on the MFD. 
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Since the AWJSBA is provided with automatic turn coordination by the sta- 
bility augmentation subsystem (SAS), the pilot need only monitor its effec- 
tiveness with the sideslip angle display feedback to the rudder shown in 
Fig. 5- The sideslip angle display is not part of the EADI but is provided 
at its left side on the instrument panel. If the sideslip angle display (or 
an inclinometer) were located at the bottom of the EADI and coupled with the 
second recommendation above, the monitoring workload could be further reduced. 

The signal within the pilot in Fig, 5 labeled cpp may contain both deter- 
ministic and random components. The deterministic component may be a feed- 
forward roll command based on the MFD for flying a curved course in the 
presence of wind. The random component may be the pilot's scanning noise. 

The heading error display, ijrg , is the difference between the selected heading 
(tr) *'bug” and the present heading (ilr) index; the perceived signals 
and i];, all of which are explicitly displayed, may also be contaminated with 
scanning noise. • 

Part b of Fig. 5 shows the displayed feedbacks and control technique(s) 
for selecting and flying a particular course exemplified by lateral guidance 
from Reference Flight Paths (RFTAV), TACAIf, VOR/DMB, ILS or MLS.* The lateral 
error display on the EADI is provided by the lateral displacement of the 
center of the path deviation window with respect to the center of the air- 
plane symbol. Lateral displacement error from the desired course can also 
be monitored directly on the MFD or on the HSI course deviation indicator. 

A course (drift) angle display on the EADI for path damping is provided only 
in the MODILS mode of guidance. (MODILS is a particular microwave landing 
system. ) Alternatively, when flying with raw situation data, the pilot must 
scan to the HSI or MFD for heading angle feedback to provide lateral path 
damping in the REAV, TACAIT, VOR or ILS modes. This is less than desirable 
and reinforces the previous recommendation that the EADI be provided with a 
heading scale. 


*The navigational aids represented by the initials are : Area Reference 

Navigation (RHAV), Tactical Air Navigation (TACAN), Very High Frequency Omni- 
directional Radio (VOR) with Distance Measuring Equipment (DME), Instrument 
Landing System (iLS) and Microwave Landing System (MLS). All employ cylin- 
drical coordinates or a portion thereof . 
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When the pilot is using guidance from RNAV, TACM, VOR/DME, ILS or MLS, 
the desired, course angle may he selected and ■will he displayed numerically 
at the extreme right of the MPD (Appendix A, Fig. A-4). The corresponding 
selected course will he displayed hy the (course) pointer on the HSI (Appen- 
dix A, Fig. A-2) and hy the (course) vector on the MFD (Appendix A, Fig. A-3). 
Whereas the HSI is always oriented "heading up," the pilot may choose to 
orient the MFD either "heading up" or "course up" for the purpose of moni- 
toring lateral-directional control or even "north up" for the purpose of 
flight planning. 

When the pilot is using guidance from RHAV, the pilot must also select 
one among four reference flight paths which he has set up and stored in 
advance hy designating a sequence of waypoint coordinates for each reference 
flight path. After the pilot has selected the number of the waypoint at 
which he wishes to enter the reference flight path, this waypoint designa- 
tion number (WPT) and its altitude (CALT) will appear in the lower left corner 
of the MFD, if enabled by the pilot. All guidance prior to passing the entry 
waypoint is three-dimensional spatial guidance. When the entry waypoint is 
passed, four-dimensional spatial and temporal guidance is initiated. The 
airspeed error from the commanded speed is presented on the EADI for the pur- 
pose of control, and the time to the next waypoint (TWPT) in the lower left 
corner of the MFD for the purpose of planning and monitoring. In addition, 
STOLAND navigation computations release a "ghost" aircraft, also displayed 
on the MFD, which travels along the rsference flight path at whatever speed 
is required for the aircraft to arrive at the final waypoing on schedule. 

The time difference (AT ) between the position of the "ghost" and the actual 
aircraft, and the predicted time error ( HIE ) shown in Appendix A, Fig. 
and described in Ref. 1 are replaced in the lower left corner of the MFD in 
other versions of STOLAND. For example , in one version the predicted time 
of arri'val (TOA) and the time delay available (TDA) at the final waypoint 
are displayed (vide Ref. 13). Present clock time is presented in the (oppo- 
site) upper right corner of the MFD. 

The content and scale of the stored maps for the MFD are selectable by 
the pilot on the MFD control (Appendix A, Fig. A-A). Presently available 
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options are described in Eef . 1, The route of the selected flight path is 
displayed on the MPD whether or not a map has been selected. 

The most dramatic differences between the HS I and MFD are in their 
respective formats which present the essential displayed feedbacks for 
confirming present position in relation to the flight plan. Although the 
HSI does not pretend to offer past and future position explicitly, even the 
interpretation of its format for present position requires mental gymnastics 
by the pilot when flying a curved course. The HSI vas designed for flying 
a straight course and, coupled with the STOLAND navigation computations, does 
a reasonable job of displaying the essential information for keeping track 
of present position when flying a sequence of different straight courses 
between waypoints. In contrast, as noted at the beginning of this lateral- 
directional topic, the MFD presents an explicit map of the terminal area 
situation with either a portion of the route or the entire intended course, 
its waypoints and navigational aids in graphic relationship with the past 
track, present position, and predicted future track of the aircraft. The MFD 
thus offers the essential ingredients both for relieving the pilot of con- 
siderable mental workload in confirming his position, and for enabling him 
to adopt higher-than- compensatory levels of skill while negotiating curved 
courses and changes in flight plan in the presence of winds. 

G. FLIGHT DIRECTOR COMMAND DISPLAYS 

The purpose of a flight director system is to reduce the pilot' perceptual 
equalization and scanning workload by combining the various displayed and pro- 
cessed variables used by the pilot in performing a given task into one command 
display which presents a single-loop compensatory tracking task for each axis 
of control. The flight director command displays must be properly integrated 
with, but must not clutter, the confidence-inspiring situation or status 
information display to which the pilot is accustomed. Whereas closed- loop 
analysis using existing pilot models will yield directly the vehicle motion 
variables which must be displayed in order to accomplish a given task (e.g. , 
Ref. 7), successful integration of the command and status displays depends on 
symbolic contrast, density, stereotypes and motion harmony in the display 


format, which must, at our present level of understanding, he validated hy 
real-time simulation and flight test with pilots. 

With regard for its impact on closed-loop system perfoimance and pilot 
workload, a good flight director system is competitive with an automatic flight 
control system for command- following and disturbance suppression. For certain 
other inputs, such as radio guidance or wind anomalies, the piloted flight 
director system performance may be superior to that of a fully automatic system. 
The flight director should permit safer operation by the pilot and copilot in 
their normal roles as active controllers and monitors of the situation. In 
this way, they are kept in the loop in case of aircraft or system failures. 
However, an additional purpose of the flight director command display is to 
provide an overall monitor on the automatic system performance both to instill 
confidence in the pilot and to permit him to take over gracefully in case of 
a malfunction. 

The flight director command displays on the EADI are shown in Fig. A- 1 in 
Appendix A. There are three command symbols and a speed error symbol, each 
uniquely associated with; a control, sometimes in a particular flight regime. 

The pitch command bar is always associated with the elevator control, and the 
roll canraand bar, always with the aileron control. During "frontside” opera- 
tion the speed error symbol on the vertical scale at the left edge of the EADI 
provides a basis for throttle trimming activity. During "backside" operation 
the throttle command symbol on the left wingtip of the airplane symbol on the 
EADI provides for the necessaiy direct powered-lift modulation. 

In an EADI for conventional aircraft there are only the two central com- 
mand bars in cruciform arrangement , one for column and one for wheel. There- 
fore, these are familiar stereotypes and their form and directions of motion 
are geometrically compatible with both the outer lOccj path deviation "window" 
and the motions of the top of the column and wheel controls . Although the 
direction of motion of the pitch command bar is also in harmony with the 
pitch axis of the EADI when the wings are level, the direction of motion of 
the roll command is not compatible with the roll axis of the EADI, because 
of its cruciform arrangement. Whether the "roll" command symbol should roll 
or translate laterally remains an issue subject to individual pilot preference. 


although results of direct compa-rative experiments with objective heading 
error measures sensitive to the roll command format have been published in 
Ref, These favor the conformable rolling director command. 

The throttle command symbol and its location on the left wingtip are 
based on the stereotype in Refs. I5 and 16 used for direct lift command in 
a helicopter flight director. However, the throttle, which is used for 
height regulation on final approach in the STOL mode in the AWJSRA., is 
operated by the pilot with his right hand, and the numerical radio altitude 
display for monitoring final approach altitude is on the right side of the 
EADI. Therefore, we offer the following recommendation. 

REC OMMMDAT lOH ; Relocate the throttle command symbol on the right 
wingtip' of the airplane symbol to reduce the scanning distance for 
monitoring numerical radio altitude and to correlate the command 
symbol location with the throttle control location on the right of 
the command pilot . 

The control laws for the command displays should be such that when the 
pilot nulls the command bars, the aircraft will be directed to the desired 
course and path in accord with the system performance-centered design require 
ments cited previously. In addition to these guidance perfomance require- 
ments, the feedback quantities for the flight director must be weighted, 
filtered and equalized in accord with a set of pilot-centered requirements, 
so that the pilot can close each flight director system loop with ease and 
efficiency. These requirements for STOL flight director systems are beyond 
the scope of this report and have already been presented and discussed in 
Ref. 3 arid applied to the AWJSRA in Refs. 6 and 7. 

H. SUl^Y Airo CONCLUSIOl© Wm RESPECT TO COl^ 

AND FUNCTION OP THE STOLAND DISPLAYS 

I. Summary 

We have summarized the preceding review of the content and function 
required of each primaiy STOLAND display in tabular form with qualifying^^^^^^^ 
comments about some of the other perceptually related attributes listed in 
Table 1 . Table 2 presents a summary review of the EADI; Table 5 r of the 
HSI; and Table 4 -, of the MFD. 
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TABLE 2. SUMMARY REVIEW OF CONTENT AND FUNCTION OF EADI 




CONTENT 

ESSENTIAL FOR 

DISPLAYED IN 
COMBINATION WITH 

SCANNING 

TRANSITION WORKLOAD 

COORDINATES, 
ORIENTATION 
AND FORMAT 

POTENTIAL 

PARAFOVEAL 

APPEAL 

SCALE QUANTUM 
AND RANGE 

Pitch Attitude and 
Horizon 

Elevator control of 
flight path (front- 
side) and speed 
(backside) 

Airplane Symbol, 
Path Deviation, 
Speed Error, Pitch 
Command Bar 

Low; centrally 
located 

Angular, 

earth, 

inside-out, 

analog 

Excellent 

2 deg over 
±10 deg 

Roll Attitude and 
Horizon 

Aileron control of 
course and heading 

Airplane Symbol> 

Path Deviation, 
Crossed Cornnand Bars 

Low; centrally 
located horizon; 
' roll scale upper 
center 

Angular, 

earth, 

inside-out, 

analog 

Excellent 
for horizon; 
moderate for 
scale 

10 deg over 
±50 deg 

Radio Altitude 

Monitoring progress 
of final approach; 
glide slope gain 
adaptation and 
terrain clearance 

Nothing else (Monitor- 
ing value only) 

Moderate; upper 
right location 

Linear, 
case, 
numer j c 

Nil 

1 ft over 
2500 ft 

Indicated Airspeed 

_ — i:—— '' ' '' ' - 

TrlTmning and sus- 
taining fll^t; 
longitudinal control 

Nothing else; useless 
for any function except 
monitoring trim value 

Moderate; upper 
left location 

Linear, 

case, 

numeric 

Nil 

1 kt from 
30 to 909 kt 

Vertical Speed 
(Optional) 

(See also fli^t 
path angle) 

Dorking height 
regulation and 
controlling ascent 
and descent 

Programmable display, 
useless for any 
function except 
monitoring value 

Moderate; upper 
central location 

Linear, 

Casey 

n^jimeric 

Nil 

100 ft/min 
over ±9900 

Heading (Optional) 

Damping course 
deviations and 
controlling direc- 
tion 

Programmable display, 
useless for any 
function except 
monitoring value 

Moderate; upper 
central location 

Angular, 

case, 

numeric 

Nil 

1 deg over 
360 deg 

Angle of Attack 
(Optional) 

Monitoring stall 
margin of safety 

Programmable display 
(monitoring value 
only) but lacks 
identity 

Moderate; upper 
1 oQation 

Angular, 

case, 

numeric 

Nil 

1 deg over 
±90 deg 

Distance to Touch- 
down (Optional) 

Monitoring approach 
progress; localizer 
gain adaptation 

Programmable display 
(monitoring value 
only) but lacks 
identity 

Moderate, upper 
central location 

Linear, 

case, 

numeric j 

■■ 1 

Nil 

1 ft over 
9999 

Flight Path Angle 
(Inertial, except 
when source is 
unavailable, then 
aerodjnaittic) 

Damping glide slope 
displacement regu- 
lation and controll- 
ing ascent and 

Programmable display 
(Optional) Monitoring 
value only, but lacks 
idontitj'- 

Moderate; upper 
central location 

Angular, 

case, 

ntuneric 

Nil 

1 deg over 
±90 deg 

descent near the 
ground 

Airplane S^bol, 
Pitch Attitude, 
Perapective Runway 

Low; centrally 
located 

Angular, 
earth, 
in side- out, 
analog 

Excellent 

2 deg over 
±10 deg 
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SCANNING 

TRANSITION WORKLOAD 

COORDINATES, 
ORIENTATION 
AND FORMAT 

POTENTIAL 

PARAFOVEAL 

APPEAL 

SCALE QUANTUM 
AND RAl'IGE 


/ Lowi centrally 
located 

Discrete, 
case, alter- 
nating black 
and white 
contrast of 
small square 

Excellent 

Go/Ho-Go 

Indication 


Low; centrally 
located 

Angular, 

case, 

analog 

Excellent 

None, but 
consonant 
with pitch 
attitude, 
path de\^a- 
tion 



Low; centrally 
located 

Angular, 

case, 

analog 

Excellent 

None, but 

consonant i 
with path \ 
deviation 

Moderate; left 

Apparently 

Moderate 

Five-point ] 

edge location 

angular. 


sclle; no i 


actually 


nunerbjs j 


linear; 




case; analog 



Low, centrally 

Angular, 

Poor, when 

None, but i| 

located 

case; analog 

nulled; good 

consonant j 


Dar 

when fluctu- 




ating 

deviation ; 

Low; centrally 

Angular 

Excellent 

Ref. T, e.g.. 

located 

and 


window is 


linear. 


7^2 m i 


case. 


(2500 ft) I 


analog 


laterally 1 


by m 
(200 ft) 
vertically 


Low; centrally 
located 

Angular, 

earth, 

analog 

Excellent 

None, but 
consonant 
with 

course, hdg 

Low; centrally 
located 

Angular, 

earth, 

perspec- 

tive 

Excellent 

See Ref. 1 

Low; centrally 
located 

Case ref^ 

Excellent 

None 

Moderate; right 
edge location 

Discrete, 

case, 

colored 

lights 

Poor, 

except 

when 

changing 

Go^fP-Uo 

indication 

' 


I 





* 
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TABLE 3. SUMMARY REVIEW OF CONTEET AED PUECTIOE' OF HSI 


CONTENT 

ESSENTIAL FOR 

DISPLAYED IN 
COMBINATION WITH 

SCANNING 

TRANSITION >roRKLOAD 

COORDINATES, 
ORIENTATION 
AND FORMAT 

POTENTIAL 

PARAFOVEAL 

APPEAL 

SCALE QUANTUM 
AND RANGE 

Heading 

Damping course devia- 
tions and controlling 
direction 

Selected Heading, 
Compass Bearings, 
course and devia- 
tion 

High; lover 
central location 
■with respect to 
EADI 

Angular, 

, earth, 
inside-out, 
numeric 

Nil 

5 deg over 
560 deg 

Selected 

Heading 

Heading reference 

Heading, etc. 

Low vith respect 
to heading 

Same as 
heading 

Good with respect 
to heading 

Same as heading 

Selected 

Course 

Course reference 

Compass Bearings, 
Course Deviation, 
To/From 

Low with respect 
to heading to 
waypoint, high 
from nav. aid 

Same as 
heading 

Good with respect 
to heading to way- 
point, poor from 
nav. aid 

Same as heading 

Bearing 1 

Present position 

Con 5 >ass, etc. 
DME 1 

Hi^ 

Same as 
heading 

Fair to poor 

Same as heading 

DME 1 

Present position 

Bearing 1 

High 

Linear, 

case, 

numeric 

Nil 

1 nm over 

299 nm 

Bearing 2 

Present position 

Compass, etc. 
DME 2 

High 

Same as 
heading 

Fair to poor 

Same as heading 

DME 2 

Present position 

Bearing 2 

High 

Linear, 

case, 

numeric i 

Nil 1 

i 

1 nm over 
299 nm 

To/From I 

Course reference 

Selected course 

Low with respect 
to selected 
course 

Discrete, 

earth, 

inside-out, 

analog 

Fair 

None 

Course 

Deviation 

(GDI) 

Control of displace- 
ment froa selected 
course 

Selected course, 
Airplane Symbol, 
To/From 

Low with respect 
to selected 
course, heading 

Linear or 

angular, 

earth, 

inside-out, 

analog 

Good with respect 
to selected course 

See Ref. 1, 
e.g., ±2 dots = 
±762 m 

(±2500 ft) 

Vertical 

Deviation 

(vDr) 

Control of displace- 
ment from vertical 
path, selected 
altitude or glide 
slope 

Nothing else 

High; right edge 
location with 
respect to GDI 

Linear or 
angular, 
case, 
analog 

Poor 

See Ref. 1 , 
e.g., ±2 dots = 
±61 m (±200 Ft) 

Warning 
Flags for 
Course 
Deviation 
and Vertical 
Deviation 

Monitoring validi-ty 
of deviations 

Course deviation 
and vertical 
deviation 

Low 

Discrete, 

case, 

colored 

label 

Good 

None 


f 
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TABLE !(., SUMMAEY REVIEW OF CONTENT AKTD FUNCTIOW OF MFD 


CONTENT 

ESSENTIAL FOR 

^ 

DISPLAYED IN 
COMBINATIGN WITH 

SCANNING 

TRANSITION WORKLOAD 

COORINDATES, 
ORIENTATION 
AND FORl-lAT 

POTENTIAL 

PARAFOVEAL 

APPEAL 

SCALE QUANTUM 
AND RANGE 

Barometric Altitude 

Monitoring altitude 
assigned by ATC 

Heading Scale 
but with 

altitude 
assigned by 
ATC 

Highj upper left 
location 

Linear, case, 
numeric 

Nil 

10 ft over 
99999 « 

Time 

Monitoring schedule 

Heading Scale 

Hi^; upper right 
location 

Hr:Min:Sec 
case, numeric 

Nil 

1 sec over 
24 hr 

Map 1 

Te;rrainal area 
feature Identifica- 
tion 

Flight Path, 
Waypoints, 
Aircraft 
SyTribol, Course 
or Heading 
Vector 

Moderate 

Selectable 

Fair 

(Uncluttered) 

Selectable 

Map 2 

Low altitude en- 
route feature 
identification 

Same as above 

High 

Selectable 

Poor 

(Cluttered) 

Selectable 

Map 5 

Experimental dis- 
play undefined 

Same as above 

— 


— 

— ^ 

Flight Path Boute 
with Waypoints 

Flight Path 
Reference STAR 
assigned by ATC j 
development of 
pursuit level of 
control for 
curved course 



Map, Aircraft 
Symbol, Course 
or Heading 
Vector 

Depends on map, 
but low, if 
centrally located 

Depends on 
map; select- 
able coordi- 
nates and 
orientation, 
analog format 

Depends on 
map, but 
probably 
better 
with CRS 
UP or HDG 
UP 

Depends on 
map 

Aircraft Symbol , 

with Trend Vector 
and History Dots 

Past track, present 
position, future 
track, course devia- 
tion, distance- to-go 

Map, Flight 
Path, way- 1 

points. Course 
or Heading 
Vector 

Low, if centrally j 
located in CRS UP 
or HDG UP Orien- 
tation 

Selectable 
coordinates 
and orien- 
tation, 
analog format 

Depends on 
map, but 
probably 
better with 
CRS UP or 
HDG UP 

Depends on 
map 

Course or Heading 
Vector 

Dainping course 
deviations and con- 
trolling direction 

Map, Aircraft 
Symbol, Flight 
Path, Way- 
points 

Low, if centrally 
located in CRS UP 
or HDG UP, orien- 
tation 

Angular; NORTH 
UP, CRS UP, or 
HDG UP; analog 
format 

Depends on 
map, but 
probably 
better with 
CRS UP or 
HDG UP 

No scale; 
360 deg 
range 

Heading Scale and 
Numeric 

Monitoring 

Barometric 
Altitude and ' 
Time 

Hig^i upper 
central location 

Angular, earth, 
inside- out, 
numeric 

Nil 

1 deg over 
^60 deg 

Waypoint and Time 
Data 

j Next waypoint iden- 
tification, altitude 
I and time schedule 
control 

Nothing else 
but appears 
cluttered like 
a check list 

Highj lower left 
location 

Mtitude and 
time; case; 
numeric 

Nil 

See App. A, 
Fig. A-3 

Reference IAS, FPA, 
AT.T, HDG, CRS 

Kbnltoring 

Mode Select 
Panel (App. A, 
Fig. A-i|) 

High; extreme 
right location 

Linear or 
angular; case; 
numeric 

Nil 

See App. A, 
Fig. A-4 

i 


V 



2. Conclusions 


a. The EADI provides inner loop attitude, flight path angle, outer 
loop path and course deviation, and speed information in the 
form of an ideal superin^josed multiloop compensatory tracking 
display for all phases of flight involving rectilinear paths 
and courses and which demand precision flying under IFR. 

b. The MFD supplements the EADI with an explicit course or heading 
oriented moving map format including track predictor, present 
position, track history, reference flight path, waypoints, 
course deviation, distance and time to next waypoint. The MFD 
presents an ideal pursuit-and-compensatory format for all phases 
of horizontal navigation involving curved courses and time 
schedule control as well as straight segments. 

c. The pilot’s scanning transition workload between EADI and MFD 
is likely to be highest in the terminal area and especially in 
following a curved approach course. A recommendation for redu- 
cing the pilot's scanning transitions between the EADI and MED 
is offered by coordinating the presentation of a heading scale 
(from the MFD) on the EADI with the roll scale. 

d. During straight final approach under IFR, the pilot's scanning 
transition workload should be largely confined to the EADI, which 
provides all the essential control information with runway per- 
spective, discrete data for monitoring approach progress, expli- 
cit numerical airspeed for trim management, and explicit numeri- 
cal radio altitude for monitoring terrain clearance and height 
above runway threshold area. 

e. The multiaxis flight director foimat presented on the EADI is a 
familiar stereotype both for controlling flight manually and for 
monitoring automatic flight control. Although originally based 
on a fomat for operating only on the "frontside" of the thrust 
required curve, the director now incorporates a suitable stereo- 
type for direct lift control in "backside" operation. However, 
a recommendation is offered for reducing the scanning transition 
workload among director axes within the EADI during "backside" 
operation. This involves relocation of the throttle command 
symbol. 

f. All the essential information for monitoring a standard or modi- 
fied terminal arrival route, holding pattern, missed approach or 
departure route is provided on the MFD together with numerical 
commanded and actual barcanetric altitude. However, the commanded 
altitude appears in a clutter of "next waypoint data" and is 
widely separated from barometric altitude. 
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g. The MFD offers a geographic format requiring less mental work- 
load and time delay hy the pilot to interpret essential infor- 
mation for horizontal navigation when it is compared with the 
HSI presentation of relative bearings and distances to navaids 
However, the HSI remains entirely acceptable for thi*ee dimen- 
sional straight course-following in area navigation (EUAV), 
because it is coupled to STOLAKD computations. 


SECTION III 


EXPERBIENTAI/ COMPARISON OF THE MED AND H3 1 WITHIN 
THE CONTEJCr OF THE WHOLE COCKPIT 


This section describes the experiuiental s imiilat ion of STOIAKD operation 
designed to gather objective and subjective data for making a systematic 
comparison of the MFD and HSI from an operational point of view under simu- 
lated instrument flight rules. 

A. SYNOPSIS OF THE EXPERIMENT 

If the display content has been suited to the task, differences in the 
display format and symbology may be apparent only if the pilot is at a satu- 
rated level of workload in a realistic flight simulation or in actual flight. 
Consequently, We attempted to emphasize a realistic air navigation environ- 
ment for short-haul aircraft in the experimental design summarized in Table 5* 
Three classes of independent variables are shown in the table . The level of 
pilot involvement is divided between two independent classes, one of which we 
have called "technique,” i.e., either manual or autcmatic, and the other of 
which we have called "the level of display,” i.e., either situation (raw data 
only) or flight director and situation on the EADI with the HSI and MFD the 
obvious independent display variables for comparison. 

The flight phases of interest in this experiment Were threefold; 1 ) the 
terminal routine within 56 km (30 nm) of Crows Landing; 2) the landing approach 
under instrument flight rules (IFR); and 3) the missed approach under lER con- 
ditions . We included the three flight phases within a class of independent 
variables repre senting the level of the pilot ' s guidance and control involve- 
ment, i.e., whether the pilot is purely tracking a standard terminal arrival 
route (STAR) assigned initially by a traffic controller and stored in the 
STOLAND system as a reference flight path, or whether the pilot is selecting 
different radio navaids en route, following an area navigation (RNAV) route , 
and maintaining geographic orientation throughout a missed approach and holding 
pattern assignment, 
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TABLE 5 . SUMMARY OF EXPERIMEMTAL DES IGN 


PILOT- 

ING 

TECH- 

NIQUE 

GUIDANCE 
AND CONTROL 
WORKLOAD 

LEVEL OF DISPLAY 

SITUATION 
(RAW DATA) 

FLIGHT DIRECTOR AND 
SITUATION ON EADI 

HSI 

MFD 

HSI 

MFD 

BOTH HSI 
AND MFD 

]yfe,nual 

Tracking a STAR 
sequence 

y XSCC* 
Highest 
Workload 

y 

XSCG* 

y 

J 

y 

EPRt 

Selecting different 
radio navaids en 
route for STOLAND 
and maintaining geo- 
graphic orientation 

J 

y 


J 

y 

EPRt 

Auto- 

matic 

Tracking a STAR 
sequence 

• 




Lowest 

Workload 



10 cells X 2 replications X 5 pilots = 100 runs 

*XSCC = Measurement of excess control capacity with 
cross -coupled secondary control task 

lEPR = Measurement of eye-point-of- regard 

Dependent Variables (i.e., Meastirements) 

a* Flight plan performance errors 

• Airspeed error with respect to commanded flight profile 

• Lateral distance error with respect to commanded course 

• Altitude or glide slope displacement error 

• Elapsed time between waypoints in flight plan 

b. Other aircraft motion and control variables [e.g», pitch and roll 
attitudes^ pitch and roll rates, heading, turn rate, airspeed iner- 
tial velocity, angles of attack and sideslip, course and path angles 
(or ground and vertical velocities ), translat ional accelerations ] 

e. Eye-point-of-regard in azimuth and elevation 

d. Subjective display ratings (e.g., cont rollab ility- and-pre c is ion, 
status utility, clutter, at tent ional demand) 

e. Excess control capacity 

f. Caution advisory response latency 



Radar vectoring without STOLAMD guidance was originally proposed as 
an alternative for reducing the cockpit workload normally required to follow 
a STAR assigned hy air traffic control. However, the reference flight path 
mode of STOLAHD already makes it almost as easy for the pilot to follow a 
STAR as if he were given radar vectors. Furthermore, the reference flight 
path mode of STOLAHD is essential to the measurement of navigational errors 
in the experiment, and it is not possible for the purpose of this experiment 
to display the equivalent of a low altitude en route IFR chart on the MFD. 
Therefore, we decided to replace the cells originally proposed for radar 
vectoring in Table 5 with cells representing higher levels of cockpit work- 
load which involve reselecting radio navigation aids en route. 

Another factor which affected the ejqjerimental design was a preliminary 
finding (during early training) while using the automatic mode of STOLAND. 

The automatic mode is so devoid of pilot workload that a critical comparison 
of the HSI and MFD cannot be made, because the pilot is not nearly saturated 
with monitoring tasks. Since some failures of the automatic mode may require 
that the pilot revert to. flying with raw situation data anyway, because even 
the STOLAND flight director guidance is provided by the automatic software, 
we decided to drop all of the cells in Table 5 involving the automatic tech- 
nique from the experimental design. 

We have indicated in Table 5 the cells in the experimental design which 

we believe to be most relevant by checkmarks. We have also indicated the 

cells which involve the highest and lowest workloads and the two cells which 
are m.ost amenable to eye -point -of -regard comparison. 

Pilot workload is high to begin with when flying the simulated C-8M 
Augmentor Wing manually with combinations of powered and aerodynamic lift. 
Since the several STAR'S involve holding patterns and curved paths as well 
as straight segments, reliance on the HSI (and EADI) without the MFD places 

the highest workload demand on the pilot, because he must keep track of his 

position mentally with the aid of his en route and terminal area charts as 
he progresses along the assigned STAR. 

Since the pilot will scan to and fixate on instruments which display 
redundant information, there is a danger in presenting both the HSI and MFD 
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when the pilot is required to fly with only raw situation data. Having hoth 
horizontal displays may actually Increase his scanning workload unnaturally 
when he is already saturated or oversaturated. Therefore, we covered the 
horizontal display which was not “being evaluated in eight cells of Tahle 
because the pilot will scan even to instruments which display no informa- 
tion or which are temporarily inactive. However, both the HSI and MFD were 
uncovered and presented to the pilot simultaneously in the two cells of 
Table 5 in the extreme right column when the pilot was using the flight 
director and situation on the EADI. We expected that any outstanding bias 
in the partitioning of the eye-point-of-regard distribution between the HSI 
and MFD might afford a measure of pilot preference for (or confidence in) 
monitoring the horizontal situation. 

Also listed on Table 5 is the estimated minimum number of 100 runs 
required for two replications of TO cells counterbalanced for order effects 
with 5 pilots. Below the table of independent variables and cells, there 
appears a list summarizing the dependent variables, that is, the measurements 
which we made. These measurements will be discussed in more detail in subse- 
quent subsections, All are self-evident except perhaps "excess control capa- 
city, " This is proportional to the value of the aircraft 's spiral divergence 
required to load the pilot to the point of saturation with control tasks while 
satisfying primary task performance with respect to a unique norm or error 
criterion established for each pilot. Excess control capacity is measured 
by increasing the spiral divergence until a stationary value is reached by 
the cross-coupled adaptive regulator of the divergence in balance with the 
performance error criterion. The stationary value of the spiral divergence 
may be normalized by its critical limit of controllability for each pilot to 
form a fraction which represents his particular excess control capacity with 
respect to the primary task. To the pilot flying the aircraft, the increased 
spiral divergence seems like a malfunction in lateral stability augmentation, 
,so the measurement can be made while the flight simulation retains high face 
validity. The measurement is so naturally embedded within one dynamic char- 
acteristic mode of the airplane, the spiral divergence, that the pilot does 
not view the workload inducing task as quite so artificial a secondary task 
as the caution advisory response task, although we shall sometimes refer to 
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the excess control capacity task as the ’’cross-coupled secondary control 
task” for convenience in the language of the report. 

B. FLIGHT ENVIROWMENT, GUIDANCE MD 
CONTROL TASK SIMULATION 

The investigation tiras conducted on the NASA-Ames fixed-base STOLAND 
simulation facility. This facility includes; l) a fully instrumented cock- 
pit j 2) a six-degree-of- freedom C-8M Augmentor Wing aircraft /environment/ 
navigation simulation program implemented on an Electronic Associates, Ihc. 
(EAI) 81 i 00 digital computer; and 3) a complete STOLAND digital avionics 
system. Ames personnel were responsible for programming operation, checkout, 
and maintenance of these parts of the simulation throughout this experiment. 

A simplified block diagram of the STOLAM) simulation facility is shown 
in Fig. 6, which is adapted from the block diagram in Fig. 8 of Ref. 17. The 


PERIPHERAL EOUIPMENT 



Figure 6. Block Diagram of STOLAND Simulation 
Facility (Ref. 17) 
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present investigation was conducted on this facility. Peripheral equipment 
is connected to the STOLAMD digital con^ruter to allow rapid program assembly, 
modification, and validation. The EAI 81^■00 digital computer simulates the 
C-8M Axjgmentor Wing aircraft, its navigational aids, the wind and gust envi- 
ronment, and drives the remaining displays which are not part of the STOLAND 
system. 

The visual field simulator vras not required for this investigation 
because the approaches were either terminated at the minimum decision alti- 
tude or were converted to missed approach procedures, and no landings were 
made. 

The cross-coupled secondary control task, which is designed to measure 
the pilot 's excess control capacity by adaptive adjustment of spiral diver- 
gence in the aircraft, and the caution advisory response task, which is 
designed to measure the pilot 's excess capacity for monitoring, were imple- 
mented on the 8t00 simulation computer. 

Guidance and control task error performance analysis with respect to 
each assigned route was provided by a subroutine within the 8400 computer. 

Up to four reference flight paths (i.e, , routes) for measuring error perfor- 
mance, however, can be stored in the STOLAND computer. Waypoints for the 
four stored routes can be changed from the STOLAND keyboard for data entry 
by either the pilot or investigator* Regardless of vrhether the pilot is 
following a STAR assigned initially by the controller or following a radar 
vector route communicated sequentially by the controller, the appropriate 
reference route must be stored and selected in the STOLAWD canputer in order 
to obtain the proper error performance measures as the flight progresses. 
Error performance measures were confined to three-dimensional spatial coor- 
dinates and did not include time errors, because the HSI does not provide 
any temporal guidance error display anyway. In this connection, we should 
emphasize that the content of the MFD and HSI are not strictly equivalent, 
because no waypoint numbers appear on the HSI and no heading scale appears 
on the MFD, if the pilot elects the nOrth-up orientation. Furthermore, the 
format of the altitude presentation on the MFD is purely numerical, and is 
more unsuitable for tracking than even the counter-pointer altimeter, let 
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alone the vertical deviation indicator (¥111) on the HSI. However, it is 
as unconventional for the pilots to use the ¥1)1 anywhere except on glide 
slope as it is to use the displacement ’‘window" on the EADI. Therefore, 
we may, insofar as the tracking control aspects of this ejcperiment are 
concerned, be comparing the EADI (supported by the MFD) with the HSI 
(supported by the EADI). notwithstanding, insofar as the geographic 
orientation aspects of the experiment are concerned, we are eon^jaring the 
HSI (supported by an ENA¥ chart and approach chart) with the MFD, which 
presents a moving map of the same EHA¥ and approach chart. Whether any 
differences between the two methods of presenting geographic orientation 
will be reflected in the measure of excess control capacity provided by 
the secondary roll tracking task remains to be seen in the subsequent 
presentation of the results. The displacement "window" on the EADI vras 
deleted when runs were made to test the HSI alone, since the HSI presents 
lateral and vertical deviation anyway. The displacement scaling of one 
"half -window" on the EADI was consistent with the displacement scaling of 
one dot on the HSI, viz., 381 m (1250 ft) laterally and 30.5 tti (100 ft) 
vertically. 

Our previous recommendation (see Section II) that heading be provided on 
the EADI' s prograjnmable display during the experiment was accepted. Our 
recommendation that the former throttle director and speed error displays 
be interchanged had already been incorporated in the EADI by Ames Research 
Center personnel prior to the experiment. We suggested to each pilot that 
the MFD be used in the course- or heading-up orientation for consistency 
with the HSI and because the heading tape on the MFD appears only when the 
course- or heading-up orientation is selected. However, the radio magnetic 
indicator ( EMI ) was always available to pre sent a compass rose when the 
HSI was covered in the event that a pilot elected to keep the MFD north-up. 
The choice of map scale on the MFD was left to the pilot; however, he was 
instructed that the STAR waypoint numbers would appear only if the 1 . 5 or 
0.5 nm/in. scales were selected. 

The reference flight path mode was used throughout the approach tracking 
portions of the experiment to insure that navigational errors were measured 
consistently for data acquisition. Attempts to convert measurements to an 
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MLS reference on approach were successful, but it was discovered during 
checkout that navigational measurements were subsequently lost on go-arounds, 
and that a major programming change beyond the scope of this experiment would 
have been required to recover the navigation errors from the MLS, 

A steady wind speed of 10 m/s (20 kt) from the east or west as required 
by the flight plan to produce a prevailing tailwind en route was used 
throughout the experiment to increase workload when turns were required. 

One combined wind speed and turbulence level was used, because this is not 
one of the independent experimental variables in this investigation, rather 
it is designed to contribute to a high level of pilot workload. The magni- 
tude and direction of the wind corresponded to seasonally premlent mean 
values, and the root-mean-square level of the turbulence was measured between 
0.9 and 1.2 m/s (5 and 4 ft/sac) depending on the variability in the small- 
sample statistic. 

C . SECQHDARY TASKS POE WOEKLQAD MEASURIMENT 

As if the workload of the simulated G-8M Augmentor Wing aircraft alone 
were not enough in itself, we added two other secondary tasks, as planned, 
to provide measurements of workload margins. These additional tasks are the 
cross-coupled adaptive spiral divergence and the caution advisory response 
tasks. That the addition of these tasks oversaturated two pilots during 
curved-course following with Flight Plan 2 using raw data is verified by 
their acknowledged inattention to the caution advisory task in turns (see 
below) . 

The cross-coupled secondary control task, which is designed to measure 
the pilot’s excess control capacity by adaptive adjustment of the spiral 
divergence in the aircraft, was embedded in the C-8M Augmentor Wing air- 
craft simulation. The necessary changes and additions are described in 
Appendix B. STI personnel were responsible for operation and checkout of 
the secondary tasks for workload measurement. 

Appendix B also describes the fanctional details of the caution advisory 
response task, which is designed to measure the pilot's simple reaction time 
to a master caution light stimulus. This task is designed to provide a 
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measure of the pilot's excess capacity for monitoring by comparing loaded 
and vinloaded reaction times. It was simulated on the 8400 computer. 

D. SBIUIATIOIT SCMARIO 

The simulation scenario was foimulated to make possible the most direct 
correspondence between simulation results and satisfaction of the basic pro- 
gram objectives. This was accomplished by addressing each of the questions 
posed in Section I and formulating more specific questions which we hoped 
to be able to answer from the results of the simulator experiment. In order 
to conduct the most meaningful comparison of the MFD and HSI, we considered 
the following four questions in preparing the terminal arrival routes for 
the scenario. 

1 . What is the degree of improvement offered by the moving 
map display (MFD) over the HSI as a function of pilot 
workload? 

2. When is a moving map display essential for safety? 

5. Can the MFD replace the HSI or is it strictly an addi- 
tion to the existing panel? 

k. What is the minimum display content required to make 
the MFD a useful display? 

The simtilation scenario has been foimulated to obtain answers to these 
questions under varying levels of pilot workload in a reasonably realistic 
air navigation environment in order to promote the practical usefulness of 
the results. 

1 . Bequlrements 

The first of the above questions leads to a requirement for routes which 
provide varying levels of workload directly involving the use of the HSI and 
MFD by the pilot. The primary purpose of the MFD is to minimize the time 
required by the pilot to become and remain confidently geographically oriented 
with respect to a set of navaids and courses. Therefore, the proper way to 
vary workload among routes is by introducing navigation problems of varying 
complexity which tend to cause the pilots to beccatie disoriented (with respect 


to position rather tlian attitude). Examples of tasks which frequently 
cause geographic orientation problems are holding patterns with a nondirect 

entry and curved path tracking. The high workload routes involved both of 
these maneuvers. 

The second of the above questions results in a requirement for tasks 
where safety is a predominant factor, even in the simulator. The missed 
approach task is appropriate here because it is, by definition, an unplanned 
abort. It is felt that the necessity (or lack thereof) of an MED for pro- 
viding geographic orientation will be most obvious to the pilots during the 
missed approach procedures in the simulation. 

The third question requires trajectories which emphasize both tracking 
(strong point of HSI) and orientation (strong point of MFD). Tracking is 
almost always a primary task in simulation experiments. However, orienta- 
tion problems require a system of navaids, airways, intersections, and the 
like which are rarely available on research simulators. Nevertheless, the 
STOLAND simulator does provide simultaneous data from a VOR (selectable), 
a TACAN (selectable), and an MES (MODILS at Crows Landing). 

The fourth question is really beyond the scope of the present investi- 
gation. However, a meaningful evaluation of the MFD requires that some 
minimum level of information be available on the display. Based on the 
review of the MFD content in Section II, we expect that the minimum level 
of information will include barometric altitude, present time, the uncluttered 
terminal area map, the selected flight route, the aircraft symbol, the trend 
vector, the heading tape, the next waypoint and its commanded altitude. As 
a result of the simulation, the pilot commentary will also contribute to the 
interpretation of what constitutes the minimum display content required to 
make the MFD useful. 

We planned the e3^eriment so as to provide answers to the third question 
(above) in two ways. First, the HSI was covered dviring some of the tests 
described; therefore, pilot performance measures and subjective ratings will 
reflect the relative success of simulated operations using only the MFD with 
the EADI. Second, we expect that any outstanding bias in the distribution 
of eye-point-of-regard (lPR) measurement when both HSI and MFD are available 
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to the pilot may suggest a preference for one display — perhaps even to 
the exclusion of the other. 

2. Standard Terminal Arrival Routes (STAR'S ) 

¥e shall describe in this topic four routes to Crows Landing designed 
to induce various levels of workload in the scenario and to avoid over- 
repetition of the same route throughout the experiment. Each route is 
described with an accompanying approach plate^ including the speed and 
altitude profiles, in Appendix C. 

Waypoint coordinates for the four flight plans were calculated to 
accommodate the STOIAKD req,uirements for reference flight paths. Tables 
of the waypoint coordinates are included in Appendix C. Missed approach 
procedures are also included for Flight Plans 5 and !<■. The four flight 
plans had the following features . 

1 ) Straight Approach with Procedure Turn . This route is based 
on the course for the standard military TACAW approach to 
Crows Landing with a missed approach consisting of a TACAW 
radial and a DME holding pattern with a direct entry. This 
route, however, was shortened to provide a deg glide 
slope and procedure turn for practicing the configuration 
changes peculiar to the simulated Augraentor Wing aircraft. 

2 ) Figure-8 Approach . This route provides a curved path in the 
form of a figure-8 requiring high attentional workload in 
the presence of wind and turbulence. It is based on a route 
designed by Ames Research Center personnel for the STOLAND 
acceptance test, it was expected that this route would pro- 
vide as crucial a test as possible for comparison of the HSI 
and MFD in tracking. 

3) Curved Approach and Go -Around to Holding Fix . This trajectory 
involves a considerable amount of configuration changing, 
ttirning, and generally planning ahead to keep oriented and 

on course. The pilots were given a few approaches without 
the missed approach as a medium workload task and to maximize 
the effect of the missed approach as an unexpected event. 

The missed approach trajectory is designed to disorient the 
pilot and to get him behind the airplane. 




4) En Route navigation. Curved Approach and. Go-Around to Holding 
Fix . The intent of this trajectory is to generate an alter- 
nate high workload situation. It is expected that the high 
workload tasks will reveal the requirement (or lack thereof) 
for an MFD. 

The basic features which are expected to induce very high 
pilot workload in the Flight Plan 5 and 4 are; 

— Altitude and speed transitions with the Augmentor Wing. 

•— Identification and tracking of VOR and TACAW radials. 

— The curved approach. 

— Missed approach with an intermediate climbing turn and 
required configuration changes. 

— Complex holding pattern entry within 5 iiiinutes of missed 
approach initiation. 

E. BATA MBASUBMEiNTS AND RECORDS 

Each of the types of measurements referred to in Table 5 h.S'S a specific 
role to fulfill in the subsequent analysis and presentation of the results 
of this investigation. We shall outline each type of measurement more 
specifically and discuss its role in this subsection. 

1 . Perf orxnance 

This group of measurements comprises three dimensions of flight plan 
error performance; airspeed and lateral and vertical position with respect 
to the reference flight path, stored in STOLAND. The time- and ensemble- 
averaged values and variability of flight plan performance errors in each 
flight phase (en route, terminal area, initial, and final approach) are 
intended to be judged in the sense of an acceptance test by comparison with 
standards of safety and schedule reliability (e.g.. Refs. 18-20). Appen- 
dix B herein presents a sample specification of the measurements, processing 
and liard copy records provided. 

' An x-y plotter provided a plan position display of flight progress, The 
x-y plotter was driven by the present position outputs from the navigation 
simulation. The altitude output was provided separately on an x-z plotter 
beside the x-y plotter. The plotters were provided with six waypoint group 
timing marks synchronized with the simulation. ^ ^ ^ 
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Flight performance errors are generally insensitive to display format, 
except possibly in circumstances where the pilot is oversaturatsd - There- 
fore, we do not expect the performance errors to help crach in discriminating 
between the HSI and MFD, but we must at least be assured that the pilots 
can maintain acceptable standards of safety and schedule reliability with 
each horizontal display candidate. 

2. Pilot Acceptance 

The "other aircraft motion and control variables" listed in Table 5 
represent motions whose variability from trimmed values or steady-state 
norms can be judged by comparison with standards of pilot acceptance (e.g.. 
Refs. 20 and 21), The measurements, processing, and hard copy records for 
these variables are also described in Appendix B. 

The EAI 8400 computer was core-memory-limited for this experiment by 
the data acquisition requirements for the en route and terminal area phases 
of flight. It was therefore necessary to reduce the number of variables 
for which we originally planned to collect samples and to reduce to six the 
number of groups of flight segments over which we averaged the collected 
samples of data. 

5. Bjre-Polnt-of-Regard 

Azimuth and elevation angular coordinates of the pilot ' s eye-point-of- 
regard were recorded on-line on two channels of a strip chart oscillograph 
with synchronized time identification. (The other four channels were for 
calibration. ) An edited list of fixation dwell time intervals was then 
prepared for each of up to eight vinique fixation points identifiable from 
a visual inspection of the strip chart records. This visual inspection 
and editing step was necessary in order to screen out artifacts such as 
blinks and secondary scans within a display and to compensate for occasional 
long-term direct voltage drift in the measurements. 

Reference 22 describes the eye -point -of -regard statistics programs which 
provides the following quantities for up to eight unique fixation points or 
instrument locations: 
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• Total dwell time, Ti 

• : Ifumber of fixations, Ni 

• Mean dwell time, 

• Dwell time standard deviation, 

• Dwell fraction, rii 

• Look fraction, vj_ 

• Look rate, fs^ 

• Dwell time histogram at 0.25 sec intervals 
The data for all instruments include : 

Total dwell time, ZTi 

• Total number of fixations, Nm 
S can rate, fs 

• One-way transition links 

The program was operated by STI (off-line) from a timesharing computation 
facility at its Mountain View branch office. We expected that the parti- 
tioning of the eye-point-of- regard distribution between the HSI and MFD, if 
biased, might afford a measure of pilot preference or confidence in monitor- 
ing the situation when he is controlling with the flight director. 

4. Subjective Rating 

Four simple pilot rating scales for use in research on and evaluation 
of manual control displays were derived and used in the pilot experiments 
reported in Ref . 23 and are well suited to the present Investigation. The 
scales shown in Table 6 are of interval-scale quality and will permit averag- 
ing and other standard parametric statistical analyses. The use of four trait 
categories (task controllability and precisionj status utility; clutter; and 
attentional demand) should help to separate subjective identification of these 
often confounded effects. Hard copy rating forms for the EADI, HSI, and MFD 
were filled out by each pilot in the cockpit at the conclusion of each simu- 
lated flight. 
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TABIJE 6. PmOT OPINION MT3UG SCALES 


RATING SCAIiE FOR XJTILITy OF STATUS INFORMATION 


RATBTG SCALE FOR CLUTTER 


ro 

I 




CRITERIA 


Usefulness^ of the 
information supplied, 
on the specified dis- 
play unit> on the 
vehicle status — - 
especially the rele- 
vant flight path 
vector states j such 
as : altitude , spe ed , 

heading attitude, 
path errors etc. 


^Useful with respect 
to the mission phase, 
task criteria, and 
operator's sense of 
vehicle safety. 


DESGRIETIVE PHRASE 

RATBfG 

All desired states presented with 
adequate re solut ion and reada- 
bility 

SI 

Many of desired states presented, 
with a few deficiencies in sca- 
ling, resolution, or readability 

S2 

Some desired states presented, 
and/or some problems with sca- 
ling, resolution, or readability 

S3 

Inadequate number of s tates , or 
serious deficiencies in scaling, 
resolution, or readability 

sk 

No direct status inf oimation or 
unusable 

S5 


CRITERIA 


Degree of suh- 
j ect ive symbol- 
baclsground 
clutter on 
specified 
display \mit 


DESCRIPTIVE PHRASE 

RATING 

Completely uncluttered — e.g., 
only one pair of elements 

Kl 

Mostly uncluttered — • no con- 
fusing or distracting elements 

K2 

Some clutter - — multiple ele- 
ments competing for attention 

K3 

Quite cluttered — difficult to 
keep track of desired quanti- 
ties among con^jetitors 

Kk 

Completely cluttered — - nearly 
impossible to tell desired ele- 
ments or quantities due to 
con^eting elements 

K5 


RATING SCALE FOR TASK CONTROLLABILITr AND RRECISION 


RATING SCALE FOR DISPLAY ATTENTIONAL WORKLOAD 


CATEGORY 

DESCRIPTIVE PHRASE 

RATING 

CONTHOLLPLE 

PRECISE 

Yes 

Yes 

: 

Very easy to control, with good 
precision 

Cl 

Easy to control, with fair pre- 
cision 

C2 

No : 

Controllable, with inadequate 
precision 

C3 

Marginally controllable 

ok 

No 

Uncontrollable 

C5 


CRITERIA 


Demands on the 
operator atten- 
tion7 s^ii7 ~ 

or effort 


DESCRIPTIVE PHRASE 

RATING 

Completely undemanding and 
relaxed 

D1 

Mostly undemanding 

D2 

Mildly demanding 

D5 

Quite demanding 

d4 

Completely demanding 

D5 






Excess Control Capacity 


An "integrated*' display such as the MFD does not necessarily eliminate 
eye scanning between symbols and improve tracking coherence, but it may very 
well increase the pilot's excess control capacity for coping with the unex- 
pected, This hypothesis deserves further test and quantification in the 
present investigation, because the results obtained in Ref. 25 with a cross-, 
coupled adaptive measure of excess control capacity appear to offer a more 
unique on-line measure of display quality than scanning workload fraction 
and a more sensitive measure than subjective rating. 

The secondary cross-coupled adaptive workload task regulated the spiral 
divergence of the aircraft inversely as a function of changes in primary task 
performance with respect to a norm or error criterion. The block diagram in 
Fig. 7 shows the principle of this unique secondary task. The error criterion 


DISPLAYS OPERATOR CONTROLLED ELEMENTS 



Figure 7. Principle of Cross-Coupled Adaptive Workload Task 
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Ec was either 1.1 or 1.2 times the unloaded performance error for best 
results in the tests here. The spiral instability was increased until a 
stationary value was reached by the cross-coupled adaptive regulator in 
balance with the performance error criterion. Either the stationary or the 
average value of the spiral divergence was then normalized by its critical 
limit of controllability for each pilot to form a fraction which represented 
his excess control capacity with respect to the primary task. , Mechanization 
of the cross-coupled workload task is described in Appendix B together with 
the measurements and records provided. This on-line task was Incorporated 
within the aircraft simulation program on the Ames Research Center's EAI 
8400 computer. The present investigation for comparative evaluation of the 
HSI and MFD employed the cross-coupled workload task only when a pilot flew 
with raw situation data. This was done in order to avoid conflicts with the 
existing STOLAHD flight director in the roll axis. The primary task perfor- 
mance measure was a weighted scalar combination of three-dimensional errors 
as described in Appendix B. 

The six groups of flight segments over which we were capable of averaging 
collected samples of data also restricted the discrimlnability of the excess 
control capacity measurement with the cross-coupled secondary control task. 
This restriction occurred because each pilot 's personal unloaded tracking 
error scores, which are identified with each group of flight segments and 
are used in regulating the secondary task, must reflect an average error 
between more than one pair of waypoints. Each flight segment so defined 
sometimes involved different levels of workload. Thus his unloaded tracking 
error scores, which must be stored and used in the appropriate group of flight 
segments to regulate the secondary task, will not necessarily uniq.uely match 
each part of the flight plan having a common level of workload. Consequently 
there is considerable variability in the excess control capacity measurements 
between waypoints, and we were compelled to rely on the ergodic hypothesis 
in order to establish statistical significance of the average measurements 
of excess control capacity over the six groups of waypoints to which the data 
acquisition was limited. 

Another factor which limited the discriminability of the excess control 
capacity measurement was the lateral control authority limitation. The 


±25 deg of -wheel authority limited the full attention baseline critical 
roll divergence to a -value between 1,2 and 1.4 rad/sec and required that we 
limit the partial-attention divergence in practice to 0.5 rad/sec to avoid 
aborting runs because of loss of control in steady turns. We also intro- 
duced an automatic feedback to reduce the instability abruptly prior to 
arriving at a waypoint where a turn was required to acquire another straight 
segment of the flight plan. This worked successfully to prevent loss of con- 
trol when the cross-coupled spiral divergence reached and was limited at 
0.5 rad/sec prior to the transient turn entry. In some instances, then/ we 
used the secondary task as a constant loading task at the fixed level of 
0.5 rad/sec during straight co\xrse segments where the workload -was lower than 
the average for a particular group of segments including a curved course. 

(For purposes of comparison, the actual spiral divergence of the G-8M A-ugmen- 
t or Wing at 120 kt is O.O67 rad/sec. This requires only 10.5 sec to double 
in amplitude.) 

6. Caution Advisory Response Latency 

Appendix B also describes another secondary task — this one discrete — 
having high face -validity in terms of recognizing and acknowledging caution 
advisories. This task is applicable to all cells in the experimental design, 
Table 5. The pilot -was required to acknowledge the advisory by pressing a 
switch whenever he noticed the master caution light. The master caution 
light was re -illuminated at random intesrvals of time (from an exponential 
distribution) after it had been extinguished by acknowledgment. Here the 
measure of excess capacity for monitoring is To/T]j, where Tl is the pilot's 
loaded response latency in extinguishing the master caution light and Tq is 
his unloaded response latency obtained -with the pilot fixating on the center 
of the EADI but not performing any other tasks. Results in Ref. 24, with a 
similar task, report good sensitivity and low -variability in response to 
changes in horizontal display format. 

The caution advisory light, as originally implemented on the forward 
console below the STOLAND Mode Select Panel, could not always be seen by the 
pilots. Therefore the alerting light was also connected to a marker beacon 
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lamp at the right of the EADI on the instrument panel, although the response 
switch remained, on the console. The mean time between advisories was 48 sec 
for all runs , 

P. PILOTS 

Five pilots, with diverse ej^erience, participated in this simulation 
exercise. Two were research pilots with experience in the aircraft being 
simulated. Two were commercial airline pilots based at San Francisco, and 
the fifth was a general aviation instrument instructor with experience as an 
engineering r'lot, A brief summary of each pilot’s background follows. Each 
pilot is identified by a code numeral used as a designator in presenting the 
results. Pilot 2 was on reserve for this simulation and did not have to be 
called to participate; therefore, we shall omit his background. 

• Pilot No. 1 . Research pilot with escperience in several STOL 
aircraft (DHC-5, DHC-6, AWJSRA, BR 94lS) as well as conventional 
aircraft (CV-340, CV-990, Lear Jet), Military experience in con- 
ventional single engine fighter and attack aircraft and extensive 
light aircraft experience. Research simulator experience in a 
variety of handling qualities experiments, e,g,, space shuttle, 

DHC-6, and AWJSRA. 

• Pilot Ho. 2 . On reserve; did not participate. 

• Pilot No, 3 « Commercial airline first officer with an Air 
Transport pilot (ATP) rating and over 78OO hours, of which over 
1000 hours have been under lER. Commercial experience includes 
Boeing 707 and 727 series and Lockheed I88A (Electra) aircraft. 
Military experience includes F-TO5D, F-IOOD, F-84 f and T-35 air- 
craft; has additional light aircraft experience and UASA-Ames 
research flight simulation experience. 

• Pilot Wo. 4. Commercial airline captain with an ATP rating and 
over 18,500 hours, of which over 8OO hours have been ixnder IFR. 

Has additional 500 hours simulator time under IFR. Commercial 
experience includes Boeing 707 and 720 series, Lockheed 049, 

749, 1049, 1649 (Constellation) series, Douglas DC-4 and Mar- 
tin 202A, 4o4 aircraft . U.S . Air Force experience includes 
B-25J, c-46, C-47 and C-54 aircraft; has additional light air- 
craft experience and MASA-Ames research flight simulation 
experience . 
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• Pilot No. 5 . General aviation pilot; has over 2500 hours 
with Commercial Flight Instructor, Aircraft, and Instrument 
as well as multi-engine ratings. Attended Flight Safety, 

Inc. DC-9 Jet Familiarization course and American Airlines 
DC-10 School; has served as an engineering pilot on several 
display evaluation programs including flight director con- 
cepts for conventional and STOL aircraft. Experience includes 
use of ground-based and in-flight variable stability simvila- 
tors (NASA Ames S- 16 , Flight Simulator for Advanced Aircraft, 
and Princeton Variable Stability Navion) for handling quali- 
ties research. 

* Pilot 1^0 « 6 . Research pilot with over 5500 hours among V/STOL 
(various 'rotary wing and CL- 84 ); STOL (DHC-2, -3, -5^ -6, and 
ANJSRA), conventional twin and single engine jet (T-33^ CL-^1, 
F-101, F5, IR23), and light aircraft. Has 200 hours of vari- 
able stability helicopter evaluation experience; instrument 
time includes 325 hours of fixed-wing experience in flight and 
200 hours in simulator with an additional 75 hours of v/STOL 
simulator experience under IFR. 


G. TRAINING AND TEST AGENDA 


Because of the unusual aircraft, novel EADI and MFD and the unfamiliar 
STAR'S, a considerable period of pilot training was required to establish 
stationary levels of proficiency comparable to that achieved for the HSI on 
straight courses. Flight Plan 1 was enployed primarily for training in order 
to avoid overrepetition of the other flight plans with which formal data 
measurements were taken. Measurement of skill development was made through- 
out training and testing using the various techniques planned, so that reason- 
able s tat ionarity in the formal results could be identified. 

The test runs for each pilot are displayed in Tables 7 through 11, 

Although care was given to counterbalance the order of presentation of 
the various cases (in Tables 7 through 11) for each pilot, we were frequently 
constrained to jraxtapose r\ms with the HSI or MFD having other attributes in 
common, because the pilots were required to render subjective comparative 
ratings of the HSI and MFD thereafter. We were also constrained by setup 
and calibration time for the eye-point-of- regard measurements to juxtapose 
runs with raw situation data or the flight director. 
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TABLE 8. RUN LOG FOR PILOT 5 
(First digit of case number identifies flight plan number) 


CASE 

KIKSER 

RUN 

NUI-IBER 

MANUAL 
TECHNIQUE 
EXCEKL’ AS 
NOTED 

LEVEL OF 
DISPLAY 
VFD = FLIGHT 
' DIRECTOR) 

HORI- 

zora'AL 

DISPLAY 

EXCESS 

COWrROL 

CAPACITY 

CAUTION 

ADVISORY 

respohsb: 

EYE 

PDINT 

OF 

REGARD 

SUBJECTIVE 

DISPLAY 

RATING 

COMMENTS 

0^1 

68-70 


FADI Horizon 

None 

Yes 

Baseline 

No 

No 

No 


062 

65 

Automatic 

rD and Situation 

Both 

No 

Yes 

Baseline 

No 

No 


101 

46 , 49 


Situation 

Both 

No 

No 

No 

No 

Training 

102 

44 , 45 


FD and Situation 

Both 

No 

No 

No 

No 

Training 

104 

51, 52 


Situation 

HSI 

No 

No 

No 

No 

Training 

108 

50 


BD and Situation 

HSI 

No 

No 

No 

No 

Training 

201 

117 


Situation 

Both 

No 

Yes 

Yes 

No 


202 

55a 


FD and Situation 

Both 

No 

Ho 

No 

No 

Training 

202 

118 


ID and Situation 

Both 

No 

Yes 

Yes 

Yes 


204 

55, ii'» 


Situation 

K 3 I 

No 

Ko (R 55 ) 
yes (R 11 u; 

No 

No 

Lost data 
(B 53 ) 

204 

58, 59 
115 


Situation 

HSI 

Yes 

No 

No 

No (R58, 
115 ) 

Yes (R 59 ) 


205 

55 b, 113 


Situation 

MFD 

No 

. 

No (R 55 b) 
Yes (R 113 ) 

No 

No 

Training 

(R 55 b) 

205 

56, 6 p, 
116 


Situation 

MID 

Yes 

Ho (R56, 
60) 

Yes (RI16) 

No 

No (R56) 
Yes (R60) 
No 


208 

111 


FD and Situation 

HSI 

No 

Yes 

No 

No 


209 

112 


FD and Situation 

MFD 

No 

Yes 

No 

No 


301 

l 48 


Situation 

Both 

No 

Yes I 

Yes 

No 


302 

149 


FD and Situation 

Both. 

No 

. Yes 

Yes 

No 


503 

65 

Automatic 

FD and Situation 

Both ' 

No 

Yes 

No 

No 


3o4 

1 4 ? 


Situation 

HSI 

Yes . 

Yes 

No 

No 


505 

l 46 


Situation 

MFD ^ 

Yes 

Yes 

No 

No 


308 

62, 64 
t 45 


FD and Situation 

HSI 

No 

No 

No 

No 


309 

61, 128, 
151 , t 44 


FD and Situation 

MFD 

. No .. 

No 

No 

No 


311 

178 


Situation 

Both 

No 

Yes 

Yes 

Yes 

♦ 

311 ^ 

174 * 177, 

245 


Situation 

HSI 

No 

Yes 

No 

No 


515 

175, 246 


Situation 

MFD 

No 

Yes 

No 

No 


31 G 

173, 247 


FD and Situation 

HSI 

No 

Yes 

No 

No 


319 

172, 248 


FD and Situation 

MFD 

No 

Yes 

No 

No 


401 

134 


Situation 

Both 

No 

Yes 

Yes 

No 


408 

135 : 


FD and Situation 

HSI 

.. No 

Yes 

No 

No 


^09 

132 


FD and Situation 

MFD 

No 

Yes 

No 

No 


4 ii 

243 


Situation 

Both 

No 

Yes 

Yes 

No 


412 

209 


ED and Situation 

Both 

No 

Yes 

Yes 

No 


4 l 4 

208 


Situation 

HSI 

No 

Yes 

No 

Yes 


415 

210 


Situation 

MFD 

No 

Yes 

No 

Yes 


4 l 8 

' 242 


ID and Situation 

HSI 

No 

Yes 

No 

Yes 


419 

244 


FD and Situation 

MID 

No 

Yes 

No 

Yes 



^Inadvertently omitted from Quarterly Progress Report ] 072 - 5 . 


TR-TO72-I: 



TABLE 9 . RUN LOG FOR PILOT 4 


(First digit of case number identifies flight plan number) 


CASE 

HUMBER 

RUN 

NUMBER 

MANUAL 
TECHNIQUE 
EXCEPT AS 
NOTED 

LEVEL OF 
DISPIAY 
(5D =: FLIGHT 
DIRECTOR) 

HORI- 

ZONTAL 

DISPLAY 

EXCESS 

CONTROL 

CAPACITY 

CAUTION 

ADVISORY 

RESPONSE 

BYE POU^ 
OF REGARD 

SUEIEC- 

TIVE 

DISPLAY 

RATING 

coi-mr-rrs 

06 l 

161-2 


EADI Horizon 

None 

Yes 

Baseline 

No 

No 

No 


062 

83 

Automatic 

FD and Situation 

Both 

No 

Yes 

Baseline 

No 

No 


101 

31, 32 


Situation 

Both 

No 

No 

No 

No 

Trainine 

102 

35, 37 
38 


FD and Situation 

Both 

No 

No 

No 

No 

Training 

102 

92 


FD and Situation 

Both 

No 

No 

Yes 

No 

Training 

105 

83 

Automatic 

FD and Situation 

Both 

No 

Yes 

No, 

No 

Training 

104 

80 


Situation 

HSI 

No 

Yes 

No 

Yes 

Training 

104 

84, 86 


Situation 

IISI 

Yes 

Yes 

No 

No 

Training 

104 

85 


Situation 

HSI 

Yes 

No 

No 

No 

Training 

104 

90 


Situation 

HSI 

Yes 

Yes 

No 

No 

Training 

105 

81 


Situation 

MFD 

No 

No 

No 

No 

Training 

105 

82 


Situation 

MFD 

No 

Yes 

No 

Yes 

Training 

105 

89 , 91 


Situation 

MFD 

Yes 

Yes 

No 

No 

Training 

108 

71 


FD and Situation 

HSI 

No 

No 

No 

No 

Training 

109 

72, 74 


FD and Situation 

MFD 

No 

Yes 

No 

No 

Training 

109 

73 


FD and Situation 

MFD 

No 

No 

No 

No 

Training 

201 

107 ^ 261 


Situation 

Both 

No 

Yes 

Yes 

No 


202 

158 


FD and Situation 

Both 

No 

No 

No 

No 


202 

165, 257 


FD and Situation 

Both 

No 

Yes 

Yes 

No 


204 

159 


Situation 

HSI 

No 

Kb 

No 

Yes 


204 

1611-/256 


Situation 

HSI 

Yes 

Yes 

No 

No 


205 

160 


Situation 

MFD 

No 

No 


Yes 


205 

163 , 260 


Situation 

MFD 

Yes 

Yes 

No 

No 


208 

106 


FD and Situation 

HSI 

No 

Yes 

No 

Yes 


209 

105 


FD and Situation 

MFD 

No 

Yes 

No 

Yes 


511 

18c 


Situation 

Both 

No 

Yes 

Yes 

No 


512 

183, 187 


FD and Situation 

Both 

No 

Yes 

No (RI 83 ) 
Yes (RI 87 ) 

No 


5i4 

185 


Situation 

HSI 

No 

Yes 

No 

Ye^ 


515 

184 


Situation 

MFD 

No 

Yes 

No 

Yes 


518 

253 


FD and Situation 

HSI 

No 

Yes 

No 

Yes 


519 

254 


FD and Situation 

MFD : 

No 

Yes 

No 

Yes 


411 

258 


Situation 

Doth 

No 

Yes 

Yes 

No 


412 

259 


FD and Situation 

Both 

No 

Yes 

Yes 

No 


4|4 

197 


Situation 

HSI 

No 

Yes 

No 

Yes 


4i5 

198 


Situation 

MFD 

No. 

Yes 

No 

Yes 


4ia 

195 


FD and Situation 

HSI 

No 

Yes 

No 

Ho 


419 

196 


FD and Situation 

MFD 

No 

Yes 

No 

No 
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TABLE 10. .RIM LOG FOR PILOT 5 
(First digit of case nimber identifies flight plan number) 


CASE 

lUMBER 

RIM 

KUMBER 

MAHUAL 
TECHNIQDS 
EXCEPT AS 
EOTED , 

LEVEL OF 
DISPLAY 
(FD= FLIGHT 
DIRECTOR) 

HORI- 

ZOETAL 

DISPLAY 

EXCESS 1 
CONTROL ; 
CAPACITY ’ 

CAUTION 

ADVISORY 

RESPONSE 

EYE 

POINT 

OF 

REGARD 

SUBJEC- 

TIVE 

DISPLAY 

RATING 


06l 

91-93 


EADI Horizon 

Hone j 

Yes 

Baseline 

Ho ■ 

1^0 

No 

1 

062 

79 

Automatic 

ED and Situation 

Both 

Ho ^ 

Yes 

Baseline 

Ho 

Ho 

. 

■1 

i 

101 

41 

■ 

Situation 

Both 

Ho 

Ho ; 

Ho 

Ho 

Training 

102 

40 


ED and Situation 

Both 

Ho 

Ho 

Ho 

No 

Training 

105/ 

79 

Automatic 

ED and Situation 

Both ' 

Ho 

Yes 

Ho 

Ho 


10)f ' 

78 


Situation 

HSI 1 

Ho ' 

Yes 

Ho 

Yes 



87 

1 

Situation 

HSI 

Yes 

Ho 

Ho 

Ho 1 

Lost data 

105 

77 

: i 

Situation ' 

MFD 

Ho 1 

Yes 

Ho 

Yes 


105 

88 

,, ] 

Situation 

MFD 

Yes 

Ho 

Ho 

Ho 


108 

75 


ED and Situation 

HSI 

Ho 

Yes 

Ho 

Ho 


109 

76 


ED end Situation 

MED 

Ho 

Yes 

Ho 

Ho 


201 

104 


Situation 

Both 

Ho 

Yes 

Yes 

Ho 


201 

119 


Situation 

Both 

Ho 

Yes 

Yes 

Ho 


202 

120 


ED and Situation 

Both 

Ho 

Yes 

Yes 

Ho 


201^- 

1 21 


Situation 

HSI 

Ho 

Yes 

Ho 

Yes 


204 

125 


Situation 

1 IISI 

Yes 

Yes 

Ho 

Ho 


205 

123 


Situation 

MED 

Ho 

Y'es 

Ho 

Yes 


205 

124 


Situation 

MFD 

Yes 

Yes 

' No 

Ho 


208 

103 


ED and Situation 

1 HSI 

Ho 

Yes 

1 No 

Yes 


208 

126 


ED and Situation 

HSI 

i ■ ' 

Ho 

Yes 

Ho 

Ho 


209 

100 


ED and Situation 

MFD 

Ho 

Yes 

Ho 

Ho 


209 

101 


ED and Situation 

MFD 

1 Ho 

1 Yes 

Ho 

Yes 


209 

1 127 


ED and Situation 

1 ^ 

MED 

Ho 

Yes 

Ho 

1 Ho 




f 


7 




Q 
— :i 

ro 

I 


VJI 


Q O 

►d S 

§g 

fog 

JO ^ 
d s® 

gl 

G 


TABLE 11 

RUN KKJ FOR PILCff 6 

(First digit of case number identifies flight plan nuniber) 


CASE 

HUMBER 

RUN 

NUMBER 

MANUAL 
TECHNIQUE 
EXCEPT AS 
NOTED 

LEVEL OF 
DISPLAY 
(FD = FLIGHT 
DIRECTOR) 

HORI- 

ZONTAL 

DISPLAY 

EXCESS 

CONTROL 

CAPACITY 

CAUTION 

ADVISORY 

RESPONSE 

EYE 

POINT 

OE 

REGARD 

. j 

SUBJEC- 

TIVE 

DISPLAY 

RATING 

COMMENTS 

311 

182 


Situation 

Both 

No 

Yes 

Yes 

No 

Training 

312 

179 


ED and Situation 

Both 

■ 

No 

Yes 

No 

No 

Training 

312 

905 


ED and Situation 

Both 

No 

Yes 

Yes 

Yes 


31 

I8l 


Situation 

HSI 

No 

Yes 

No 

Yes 

Training 

314 

224 


Situation 

HSI 

No 

Yes 

No 

Yes 


315 

180 


Situation 

MED 

No 

Yes 

No 

Yes 

Tr£iining 

315 

225 


Situation 

MED 

No 

Yas 

No 

Yes 


318 

204 


ED and Situation 

HSI 

No 

Yes 

No 

No 

Training 

318 

226 


ED and Situation 

HSI 

No 

Yes 

No 

Yes 


319 

205 


ED and Situation 

MED 

No 

Yes 

No 

No 

Training 

319 

227 


ED and Situation 

MED 

No 

Yes 

No 

Yes 


4n 

194 


Situation 

Both 

1 No 

No 

Yes 

No 

EPR data 
not usable 

4ll 

217 


Situation 

Both 

L - 

Yes ' 

Yes 

Yes 


412 

216 


ED and Situation 

Both 

. - No - 

Yes 

Yes 

No 


4l4 

207 


Situation 

HSI 

’ No 

Yes 

No 

No 


415 

214 


Situation 

MED 

No 

' Yes 

! No 

No 


4i5 

21 8 


‘ Situation 

MED 

No 

‘ Yes 

' No 

* No 


418 

192 

- 

1 ' , 

ED and Situation 

1 HSI 

No 

! Yes 

No 

No 


4i9 

191 


ED and Situation 

' MED 

No 

Yes 

No 

No 




The first digit of the "case number" in Tables 7 through 11 identifies 
the flight plan number. If the second digit of the case number be "0/* 
the pilot was restricted to tracking the reference flight plan using the 
"reference flight path" mode of STOLAllDj if the second digit of the case 
nvimber be "1," the emphasis was on geographic orientation using different 
radio navaids en route, missed approach, go-around and holding pattern as 
well as on tracking the approach course and glide slope. If the first and 
second digits of the case number be "06," the run was for the purpose of 
acquiring baseline performance on a secondary task and did not involve a 
flight plan. 

H. RESULTS OP THE EXPERIMENT 

Before introducing the several forms of comparative results, we will 
reiterate an important point which we made previously, viz., that the dis- 
play content of the MFD and the HSI are not strictly equivalent. Therefore, 
we may, insofar as the tracking control aspects of this experiment are con- 
cerned, be comparing the EADI (supported by the MFD) with the HSI (supported 
by the EADI without displacement^ information). Notwithstanding this, inso- 
far as the geographic orientatio n aspects of the experiment are concerned, 
we are conparing the HSI [supported by an area navigation (ENAV) chart and 
an approach chart] with the MFD, which presents a moving map of the same 
ENAV and approach chart . Although we will continue to label the displays 
being compared as "HSI" and ’*MFD" for conciseness in presenting the results 
where one or the other horizontal display was uncovered, the reader should 
clearly understand that "HSI" means "HSI, EADI (without the displacement 
window) and other instruments" and that "MFD" means "EADI, MFD and other 
instruments." The reader may wish to review Ref . 1 for a more complete pic- 
torial description of the instrument panel arrangement, content, and sym- 
bology. ly design, the HSI and MFD are being canpared within the context of 
.the whole STOLAND display and control arrangement in the simulation cocl5p it. 

We shall now turn to the presentation of the several foms of compara- 
tive results of the experiment under the following subordinate topical 
headings : 


I ■ ! 

•! Blilmders 

• Tracking errors 

• Excess control capacity 

: I 

1^1 

•l .Pilot opinion ratings 

• Pilot coniments 

• Eye-point-of-regard measurements 

1 . Blunders 

About 160 simulated flights, each lasting from 10 to 25 minutes in time, 
and distributed as shown in Tables 12 and 15, were conducted among the four 
standard terminal arrival routes in Appendix C. For each entry in rabies 12 
and 15 the numbers of runs are sequentially listed for Flight Plans 1, 2, 5, 
and 4. Notice also from the ”pilot subtotals’* columns at the right that, 
because of other commitments, the exposure of Pilots 1 and 5 necessarily 
less than that for Pilots 5 , 4, and 6. 

The most dramatic results are the 20 "blunders” partitioned in Tables l4 
and 15. The types of ”blunders" identified include loss of geographic orien- 
tation, loss of altitude awareness, and loss of roll attitude control as well 
as some others. Table 1 4 partitions the 9 blunders which occurred in the 
first phase of the experiment while the pilots were tracking primarily refer- 
ence Flights Paths 1, 2, and 3. The format of the table includes the number 
of bl-unders followed by the run number/pilot number. Table 15 partitions the 
remaining 11 blmders which occurred during terminal area and en route flight 
with en^hasis on geographic orientation (as well as tracking) in the second 
phase of the experiment involving only Flight Plans 3 and 4 with three dif- 
ferent radio navaids. 

While tracking reference flight paths exclusively (Table l4), five blun- 
ders involved the HSI and four> the MFD. However, during terminal area and 
en route flight with emphasis on geographic orientation (Table 15), eight 
blunders involved the HSI, two the, M 1 both displays. The flight 

director vjas (or should have been) in use during 11 of the 20 runs wherein 
blunders occurred. Since 7 of these 11 blunders were also associated with 
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TABLE 12 

DISTRIBUTION OF RUNS AMONG PILOTS WHILE TRACKING REFERENCE FLIGHT PATHS 
NUMBERS OF :'UNS ARE SEQUENTIALLY LISTED FOR FLIGHT PLANS 1, 2, 5, ^ 


PILOT 


Data 

Subtotals 


HSI 


0, 2y T, 0 
2, 5, 1, 0 
5> 3/0, 0 

2, 2, O, 0 


9, 12, 2, 0 


RAN DATA 
MFD 


BOTH 


0, 3, 1, 0 0, 3, 1, 0 

0 , 5 , 1 , 0 2 , 1 , 1 , 1 

If, 3, 0, 0 2, 2, O, 0 


2 , 2 , 0 , 0 1 , 2 , 0 , 0 


6, 13, 2, 0 5, 8, 2, 1 


20, 33, 6, 1 


■ 


FLIGHT DIRECTOR 

PILOT 

qttd 

HSI 

MFD 

BOTH 

DUXS— 

TOTALS 

0, 1, 1, 0 

0, 1, 1, 0 

0, 3, 1, 0 

19 

1,1, 3,1 

0, 1, If, 1 

2, 2, 1, 0 

36 

1, 1, 0, 0 

3, 1, 0, 0 

5> 0^ 0 

32 

1, 2, 0,0 

1, 3, 0, 0 

1, 1, 0, 0 

20 

3, 5, If, 1 

6, 5, 1 

T, 9, 2, 0 



Ilf, 20, 11, 

2 



TOTAL 


3if, 53, IT, 3 


10T 
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TABLE 15 


DISTRIBUTION OF RUNS AMONG PILOTS DURING TERMINAL AREA AND EN ROUTE PLIGHT 
WITH EMPHASIS ON GEOCSIAPHUC ORIENTATION. NUMBERS OF RUNS ARE 
FOR FLIGHT PLANS 5, 4 ONLY. (FLIGHT ELANS 1, 2 NOT USED) 


PILOT 


Display Subtotals 
Data Subtotals 
Fli^t Plan Totals 

TOTAL 


1 RAW DATA 

ILIGHT DIRECTOR 

1 

MFD 

BOTH 

HSI 

MFD 

BOTH 

0, 1 

0, 1 

0, 1 

0, 2 

0, 1 

0, 1 

3, 1 

2, 1 

1, 1 

2, 1 

2, 1 

0, 1 

h 1 

h 1 

h 1 

h 1 

1, 1 

2, 1 

2, 1 

2, 2 

1, 2 

■ ' . 

2, 1 

■ 

2, 1 

2, 1 

6, 4 

,5,: 5 

3, 5 

5, 5 

5, 4 

4, 4 

14, l4 

14, 13 


PILOT SUBTOTALS 


28, 27 

55 
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TABLE 14 


DISTRIBUTION OP BLUITOERS WHILE TRACKING REFERENCE PLIGHT PATHS 


Ti T. TIN DT] ■R R 


RAW 

DATA 

. 

FLIGHT DIRECTOR 


HSI 

lyiFD 

HSI 

MFD 

Loss of geographic orientation 

2 


Hone 

None 

None 

Loss of altitude awareness 

1 

'lhl!3 

Hoke 

None 

r 1 W3 

Loss of .roll attitude control 

1 

85/4 

1 8i/4 

None ; 

, ri22/3 
1 73A 

Impacted ground at GPIP’*' (below 
MBA®) 

1 ■ 

1 

! 

121/5 

Hone 

None 

■ ; 

; Hone 

t . 


'Refer to Table 12 for the different numbers of runs to v/hich each pilot was 
exposed. 

t Format for presentation of data is: number of blunders followed by designation 

of run no. /pilot, 

^Glide path intercept point. 

^Minimum descent altitude. 












TABLE 15 

DISTRIBUTION OF BLUNDERS DURING TERMINAL AREA AND EN ROUTE FLIGHT 
WITH EMPHASIS ON GEOGRAPHIC ORIENTATION* 


BLUNDERS 

RAW DATA 

PLIGHT 

DIRECTOR^ 

BOTH HSI 
AND MFD 


HSI 

MFD 

HSI 

WITH PD 

Loss of geographic 
orientation 

None 

None 

5 j 

f 192/6^ 
195 /^^ 

1 247/3 

None 

Loss of altitude awareness 

None 

p 1 214/6 ("crash") 
( 218/6 (missed 
capture) 

1 

242/3 

None 

Loss or roll attitude 
control 

None 

None 

2 j 

(203/6 
[ 253/4 

1 209/3 

"Co-pilot error" ® 

None 

None 

1 

wh 

None 

Experimenter's error' 

1 207/6 

None 


None 

None 


Refer to Table 13 for the different numbers, of runs to which each pidot was exposed. 

^Format for presentation of data is: number of blunders followed by designation of run no. /pilot. 

^There were none with MFD and Flight Director (FD). 

®A.lthough there was no copilot in this experiment, this error was committed by a test assistant after 
the pilot requested that he help with the tuning of radios during an interval of workload saturation 
Although counted in the 1 1 blunders cited, it is not a "pilot error" and may be omitted, if desired. 

'This error resulted from a failure to ej^lain to the pilot the purpose of the "TACAN/WAY PT" switch 
on the HSI. Thus it is not originally attributable to "pilot error" and may also be omitted from 
the 1 1 blunders cited, if desired. 











the HSI (Table I5), fche combination of using the HSI for orientation -with 
the flight director for tracking while selecting different radio navaids 
for guidance seemed to conspire to produce the most blunders. There were 
no blunders involving the MFD and flight director in Table 15 and only three 
in Table l4. Therefore, we would conclude from the simulation, on the basis 
of the blunder distribution alone, that the MFD seems to offer a worthwhile 
improvement in safety, since 1 3 of 20 blunders involved runs wherein the t'^D 
vras not available to the pilot. [The benefits of safety in airline operations 
are difficult to quantify in terms commeasurable with cost . The difficulties 
are both theoretical and practical. By means of an argument too involved to 
repeat here, however, Ref. 25 concludes that the risk-value preference for 
voluntary activities (such as flying) is; 


V - —8050 r^/^ (^) 


^/person 

year 



where r is the existing risk of a fatality per person-hour and Ar is the 
change in risk provided by new technology or opera,ting procedures. (The latter 
is negative for an improvement in safety.) Thus, for example, if the risk of 
a fatality per person-hour is 10~^ (typical of commercial aviation), a I per- 
cent improvement in safety (Ar/r = -0.01 ) is worth $0,805 person per year. 
This figure, multiplied by the number of persons per year exposed to the risk 
yields the utility ^ those people of the improvement in safety. ] 

The blunder distribution provides a quantitative basis for answering the 
first two questions which were posed in the formiilation of the scenario, viz., 

• What is the degree of improvement offered by the moving 
map display (MFD) over the HSI as a function of pilot 
vrarkload? 

• 'When is a moving map display essential for safety? 

Recall that the pilot workload was increased further in the second phase 
of the experiment by introducing navigation problems associated with the missed 
approach which tended to cause the pilot to become disoriented with respect to 
geographic position. This resulted in blunder distribution ratios of 8:2: 1 
among the ESI, the MFD and both displays in the second phase of the experiment 
involving 55 runs distributed in the ratios 20:19*. 1 6 among the displays in the 
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same order. The blunder-to-run proportions in the second phase were thus 
0,4:0,11 :0,06 among HSI, MID and both displays. In the first phase of the 
experiment which involved tracking reference flight paths exclusively, the 
blunder-to-run proportions were 0, l4:0,11 :0 among HSI, MPD and both dis- 
plays. In terms of this particular proportion, the MFD is independent of 
the increase in workload, whereas the HSI suffers an adverse increase with 
the increase in radio navaid/orientat ion workload — especially when the 
flight director is in use. The numerical values of this particular propor- 
tion thus afford measures of the relative improvement offered by the moving 
map display (MFD) over the HSI as a function of the increase in pilot work- 
load. The proportions also suggest (by their greater disparity) that the 
moving map was more essential for safety in the second phase of the experi- 
ment than in the first phase. 

2. Tracking Errors 

Probably the least dramatic results are to be found among the flight plan 
tracking errors in three dimensions (lateral and vertical displacement and 
airspeed) and the related variations in aircraft motions, Exatt 5 )les of these 
results are given in the plan views, Figs, 8-1 4, and the sampled statistics 
in Figs. 15-18. As one would expect, there are very consistent differences 
between tracking errors with and without the flight director among the plan 
views and between the altitude errors in Figs. 17 and I8. It is therefore 
no surprise that the flight director provides much more precise tracking of 
the reference flight plans than otherwise. However, there is no consistent 
evidence of difference s between tracking errors with the HSI versus the MFD . 
Figures 8, 9, and I 5 offer sane examples of larger tracking errors with the 
HSI using raw situation data and no flight director, but even these differ- 
ences became less distinct with more practice in the prevailing wind. Flying 
a curved course precisely in the presence of wind with no flight director was 
very difficult on the first encounter — even with foreknowledge of the pre- 
vailing wind. One pilot called it unrealistic. All, however, were able to 
do it acceptably on the simulator with practice and intense concentration. 

In fact, those pilots who were using STO LAUD for the first time considered 
the HSI a good display because of the way in which it was coupled to the 

(Text continues on p. 77) 
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Figure 8. Some Plan Views of Flight Path 2 as Executed 
by Pilot 1 Using Various Displays. Circled 
Waypoints Define Reference Flight Plan 2. 
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Figure 9. Some Plan Views of Flight Path 2 as Executed by 
Pilot 1 Using Various Displays. Circled Waypoints 
Define Reference Flight Plan 2. 
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Figure 10. Some Plan Views of Flight Path 2 as Executed hy Pilot 3 Using Various Displays; Solid 
Lines Represent the Reference Flight Plan; Broken Lines, the Trajectory of the Aircraft 
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Figure 1 1 . Some Plan Views of 5'light Patli 2 as Executed by 
Pilot k Using Various Displays. Circled Waypoints 
Define Eeference Flight Plan 2. 
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Figure 12. Some Plan Views of Flight Path 2 as Executed by 
Pilot 5 Using Various Displays. Circled Waypoints Define 
Reference Flight Plan 2. 
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Figure l4. Some Plan Views of Flight Path 5 as Executed by Pilot 5 
Using Various Displays; Circled Waypoints Define Flight Plan 5 
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Figure 1 5. Sampled Statistics for Flight Plau 2j AH Riins with Raw 
Data by Pilot 1 ; Mean Values ± One Standard Deviation 
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reference flight path automatically without pilot intervention to select 
each new course segment. However, no waypoint numbers appeared on the HSI, 
and their addition would eliminate one (unnecessary) reason for part of the 
intense concentration required when using the HSI without the MFD. 

Appendix G herein presents the balance of the graphical summaries of 
sampled tracking error statistics for the experiment. The flight director 
continues to provide for more precise tracking of the assigned altitude and 
the glide slope than otherwise (see Figs. G-1 to G-5 for examples). Again 
there is no consistent evidence of differences between tracking errors with 
the HSI versus the MFD even with only raw data. Yet, as we mentioned in 
beginning the discussion of results, the ’1®!)" implies the use of the inte- 
grated EADI as the tracking display, and occasionally better altitude-keeping 
performance appears with the "MFD" than with the "HSI" (see Figs. G-2b, G-5^ 
G-6 to G-8 for examples). 

Figure 19 provides some evidence of differences in altitude tracking 
error performance between the "HSI" and "MFD, " which may be attributable to 
differences in skill development or scanning policies or both. Figure 19 
presents the sampled root mean square (rms) vertical position error versus 
the sampled rms normal component of the gust velocity for each of the six 
waypoint groups in Flight Plan 2. (Recall that, although one turbulence 
level was set in the simulation, the measured root-mean- square level fluc- 
tuated, depending: on the variability in the small-sample statistic.) The 
interpretatioix of the unit gain crossover frequency, ooq, for the vertical 
position tracking loop associated with each data point is based on the dis- 
turbance crossover model = crwg/^c without pilot remnant, where is the 
rms vertical position error and a^g is the rms normal gust velocity. In most 
of the waypoint groups for Flight Plan 2 in Fig. 19 except 7-9 (90 deg turn 
and downwind leg), there is 'evidence in the escalating crossover frequencies 
for some skill development between replicates, but there is also evidence for 
a larger differential in crossover gain between the HSI and MFD in the earlier 
encounters . The inferred crossover gain for the HSI is the lowest in 5 of 6 
waypoint groups during the earliest run (98) among those for which data is 
shown in Fig. I9. The inferred crossover gain for the MFD is highest during 
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the final approach (Waypoints 11-15) in the latest run (159) among those 
shown. One plausible interpretation for the trends in Fig. 19 is based on 
the pilot's evolution of a scanning policy involving the EADI which simply 
improves his vertical position loop tracking gain with practice, regardless 
of whether the HSI or MFD is used. 

3. Excess Control Capacity 

The measurement of excess control capacity was provided, by the average 
cross-coupled adaptive spiral divergence in selected runs with either the 
HSI or the MFD. The null hypothesis of equality between mean values of 
excess control capacity within comparable pairs of waypoint groups with 
either display arrangement was tested for significant differences. The 
results of these tests are listed in Table l6 by pilot and flight plan. The 
column heading "neither" identifies the number of comparable pairs of way- 
point groups for which the null hypothesis was accepted. The probability of 

TABLE 16 

NUMBER OF COMPARABLE PAIRS OF WAYPOINT GROUPS FOR WHICH ONE OR 
THE OTHER DISPLAY ARRANG EXHIBITED SIGNIFICANTLY GREATER 

AVERAGE EXCESS CONTROL CAPACITY AT THE 0.05 LEVEL* 


PILOT 

FLIGHT PLAN 

hsi/eadi 

NEITHER 

eadi/mfd 

1 

2 

1 

L 

y. 1 

5 

2 . 

3 


1 

5 

3 

: Vu- ■ 




■ ':2 ^ 

;;T:;>Y>':;5;- y'.,. 


6 

5 

2 

:■ .'I; ,Y 

;::i: 


Totals 

:'■ ■■ 11 


i6 


*The null hypothesis is "neither. " The probability of rejecting 
the null hypothesis when it is true is 0.05. Behrens ' , Scheffe' s, 
and Tukey's tests (Refs. 26-28) produced consistent results. 


T9 


rejecting the ntill hypothesis when it is true is O.O5. Behrens’, Scheffe's, 
and Tukey's tests (Refs. 26-28) produced consistent results under the ergodic 
hypothesis, because the number of samples available within each waypoint 
group was on the order of several hundred or more. 

The column headings "HSI" or "MPD" identify the numbers of comparable 
pairs of waypoint groups for which the null hypothesis was rejected, i.e., 
for which one or the other display arrangement esdiibited significantly 
greater average excess control capacity at the 0.05 level. The totals show 
that the null hypothesis was rejected for 27 of 58 pairs at the 0.05 level. 
Of these 27 pairs, the "MFD" exhibited greater average excess control capa- 
city for 16, and the "HSI" greater for 1 1 pairs . In the individual case of 
Pilot 5 tracking Flight Plan 2 involving only a curved approach, the parti- 
tion is in favor of the "HSI," a result which was consistent with that 
pilot’s own appraisal of that flight plan. However, the partition for 
Pilot 5 with Flight Plan 5, involving a missed approach and holding pattern 
and is in favor of the IIFD. 

!<•. Excess Monitoring Capacity 

The measurement of excess monitoring capacity was inversely proportional 
to the average caution advisory response time. The null hypothesis of 
equality between mean response times within comparabl e, pair 3 of runs with 
either display arrangement was tested for significant differences after a 
correction for the skewness of the response time distribution was made. The 
results of these tests are listed in Table 17 by pilot. The column heading 
"neith’r.r" identifies the number of comparable pairs of runs for which the 
null hypothesis was accepted. The probability of rejecting the null hypo- 
thesis when it is true is 0.05. Again Behrens ' , Scheffe’ s, and Tukey’s 
tests produced consistent results, because there were usually at least 
eleven samples in the ensemble for each run. The column headings "HSI" or 
•"MFD" identify the numbers of comparable pairs of runs for which the null 
hypothesis was rejected, i.e. , for which one or the other display arrange- ■ 
ment exhibited significantly greater average excess monitoring capacity at 
the 0.05 level. The totals show that the null hypothesis was rejected for 
15 of 38 pairs at the 0.05 level. Of these 13 pairs, the "MFD" exhibited 
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greater average excess control capacity for 10, and the "HSI" greater for 
3 pairs. 

Table 17a presents a partition of the number of comparable pairs of runs 
for which one or the other display arrangement exhibited significantly greater 
average excess monitoring capacity at the 0.05 level when the flight director 
was available to the pilot. The null hypothesis was rejected among only 5 
of l6 pairs, and the 5 rejections are split 3:2 in favor of the MFD. 

Table 17b presents partition of the number of con^jarable pairs of runs 
for which one or the other display arrangement exhibited significantly greater 
average excess monitoring capacity at the 0.05 level when only the raw situa- 
tion data was available to the pilot. The null hypothesis was rejected among 
8 of 22 pairs, and the 8 rejections are split 7:1 in favor of the MFD. 

Table 18 presents a different type of partition of the number of compar- 
able pairs of runs for which either the raw situation data or the flight 
director exhibited greater average excess monitoring capacity at the 0.05 level 

TABLE 17 

NUMBER OF COMPARABLE PAIRS OF RUNS FOR WHICH ONE OR THE OTHER 
DISPLAY AEEANCMENT EXHIBITED SIO^IFICANTLY GREATER 
AVERAGE EXCESS MONITORING GAPACITI AT THE 0.05 LEVEL* 


PILOT 

HSI/EADI : 

NEITHER 

EADI/MFD 

1 


4 

1 

5- : • ■ 

0 ■ ■ 

7 -^ 

2 


'V 0 


2 

5 

i : :: 

' 4 ; ; 

1 

6 


::_i_ ■ 

4 

Totals 


^ : 

10 


*The null hypothesis is "neither . " The probability of 
rejecting the null hypothesis when it is true is 0.05. 
Behrens*, Scheffe's, and Tukey's tests (Refs. 26-28) 
produced consistent results. 
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a) PARTITION F: 

PILOT 

1 

5 

4 

5 

6 

Totals 


TABLE 17 (Concluded) 


PLIGHT DIRECTOR AVAILABLE TO THE PILOT 


hsi/eadi 

NEITHER 

EADI/MFD 

1 

1 

0 

0 

5 

0 

0 

5 

0 

1 

1 

1 

0 

1 

2 

2 

11 

3 


B) PARTITION R: ONLY RAW SITUATION DATA AVAILABLE TO PILOT 


PILOT 

HSI/EADI 

NEITHER 

EADI/MPD 

1 , 

0 

3 

.1: • 

5: 

0 

2 

V - V2 


;:V VO , ; . 

6 

;:2 . ■ ’ 

5V: 

; 0 ; / 

5 

: ;,V; -OV : 

6:::;VV : 

■ ^ ' JL ' 

0 

V 2 / 

Totals 

v:vv.v 1 -V 

14 

: 1 
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TABLE 18 


NUMBER OF COMPARABLE PAIRS OF RUNS FOR WHICH EITHER THE RAW 
SITUATION DATA OR THE FLIOiT DIRECTOR EXHIBITED SIOIIFICANTLY 
GREATER AVERAGE EXCESS MONITORING CAPACITY AT THE 0.05 LEVEL* 
WHEN BOTH HSI AND MFD WERE AVAILABLE TO THE PILOT 


PILOT RAW DATA 

NEITHER 

FLIGHT 

DIRECTOR 

1 ■ ■ , 

0 

1 

1 

5 

2 

2 

0 

li 

0 

3 

2 

5 

0 

0 

2 

6 

0 

1 

1 


“ ' 


" ' * 

Totals 

2 

7 

6 

'The null hypothesis is 

"neither." The 

probability 0: 

rejecting the 

null hypothesis when it 

is true is 0.0! 


Behrens’, Scheffe's, andTukey’s tests (Refs. 26-28) 
produced consistent r(=sults. The runs represented in 
this table are mutually exclusive of the runs repre- 
sented in Tables 1 7, 17a, and 17h. 

•when both HSI and MFD were available to the pilot . Thus the runs represented 
in Table l8 are mutually exclusive of the runs represented in Tables 17; 
and 17b. In Table I8, the null hypothesis 'tvas rejected for 8 of 1 5 pairs ^ 
and the 8 rejections were split 6:2 in favor of the flight director. 

5. Pilot Opinion Ratings 

Summaries of the subjective opinion ratings of the HSI and MFD by each 
of Pilots 5, and 5 during the tracking of reference flight paths are pre- 
sented in Table 19. A comparison of the t'wo pages of Table 19 shows that the 
task controllability and precision was rated substantially the same by these 
pilots regardless of whether they were using the HSI or MFD. There is, how- 
ever, a slight tendency to favor the MFD with fair precision, whereas there 
are more ratings of the HSI with inadequate precision. Comparison of the 
ratings for utility of status information between the HSI and MFD shows more 
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TABLE 19a 

MFD SUMMARY OF 3 RATITTGS OF MFD BY EACH OF PILOTS 5, 4, 5 WHILE TEACKHTG REFERENCE FLIGHT PATHS 

(Each Check or Symbol Indicates One Eating by One Pilot) 


O 


if 

iris' 


43- 


05 

■P.- 


PILOT OPINIOH RATING SCALES 

RMISG SCAIE n® OTniEf OF STATUS IHFQRKA.TION 


CRITERIA 

DESCRIPTIVE PHRASE 

EATUTG 

Usefulness®’ of the 
information supplied, 
on the specified dis- 
play unit, on the 
ve!:icle status — 
especially the rsle- 
\'ant flight path 
vector states, such 
as: altitude, speed, 

heading attitude, 
path error; etc. 

r ^Useful V’itk respect 
to the mission phase, 
task criteria, and 
operator's sense of 
vehicle safety. 

All desired states presented with 
adequate resolution and reada- 
bility 

SI 

Many of desired states presented, 
wiwh a few deficiencies in sca- 
ling, resolution, or readability 

S2 

Some desired states presented, 
and/or some problems with sca- 
ling, resolution, or readability 

S3 

Inadequate number of states, or 
serious deficiencies in scaling, 
resolution, or readability 

S4 

iTo direct status information or 
unusable 

S5 

KATiria SCALE FOR TASK CQimiOIIJffirL2TY /CN^^ 

CATSaORT 

DESCRIETiVE PHRASE 

: .. : 

R.AT31IG 

CCUTHOIIAB'^S 

PRECISE 

Yes 

Yes 

Very easy to control, with good 
precision 

Cl 

Easy to control, with fair pre- 
cision 

C2 

IJo 

Controllable, with inadequate 
precision 

C5 

Marginally controllable 

C4 

IJo 

Uncontrollable 

C5 


JJJJW 


EATIUG SCAI® FOR CLUTTER 


CRITERIA 

DESCRIPTIVS PHRASE 

R.aTir;G 

Degree of sub- 
jective symbol- 
background 
clutter on 
specified 
display unit 

' 

. 

1 

Completely uncluttered — e.g., ' 
only one pair of elements 

K1 

Mostly uncluttered — no con- 
fusing or distracting elements 

K2 

Some clutter— multiple ele- ' 
ments competing for attention 

K5 

Quite cluttered — difficult to 
keep track of desired quanti- 
ties among competitors 

Kb 

Completely cluttered — nearly 
liipossiblo to tell desired ele- 
ments or quantities due to 
conroeting elements 

X5 

RATIRG SCALE FOR DISPLAY ATTEI^TIONAL WORKLOAD 

CRITERIA 

DESCRIPTIVE PHRASE 

rath:g 

Demands on the 
operator atten- 

Conpletely undemanding and 
rela:ced 

D1 

or effort 

' 

i 

Mostly undemanding 

D2 

Mildly demanding 

D5 

Quite de-manding 

Dt 

Completely'- demanding 

3)5 


UJJJJ 

UJ 


JJ 

JJJJJJ 

J 


ContrcIlJJble >dth tUf f iculty or C2.;5 
high workload^ but fair precision 


= Raw data. 0> Flight dire etc r and situation. 
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TABLE 19 b 

HSI — SUMMARY OF 5 RATINGS OF HSI BY EACH OF PILOTS 3, 4, 5 WHILE TRACKING REFERENCE FLIGHT PATHS 

(Each Check or Symbol Indicates One Rating by One Pilot) 

PILOT OPINION RATING SCALES 


RAIHSB SCALE FOR OTE,lTr OF STATUS INFORMATIOH 


CRITERIA. 

DESCRIPTIVE PHRASE 

RATING 

Usefulnes s®' of the 
infonoation supplied, 
on the specified dis- 
play unit, on the 
vehicle status — 
especially the rele- 
A'ant flight path 
vector states, such 
as: altitude, speed, 

heading attitude, 
path error j etc. 

All desired states presented with 
adequate resolution and reada- 
hility 

SI 

Many of desired states presr^.ted, 
i-rith a few deficiencies in sca- 
ling, resolution, or readahility 

S2 

Some desired states presented, 
and/or some problems with sca- 
ling, resolution, or readability 

S3 


: 

Inadequate number of states, or 
serious deficiencies in scaling, 
resolution, or readability 


^Useful with respect 
to the mission phase, 
task criteria, and 
operator’s sense of 
vehicle safety^ 

su 

No direct status information or 
unusablo 

S3 

RATING SCALE FOR TASK CONTROLLABILITY AND PRECISION 

CATEGOEY 


RATING 

COirrKOLLABLE 

PRECISE 




Very easy to control, with good 
precision 

Cl 

Yes 

les 

Easy to control, with fair pre- 
cision 

C2 



Gontrollable, >riLth inadequate 
precision 

C5 


No 

Marginally controllahle 

Clf 

No 


Uncontrollable 

C5 


JJJJJ 

J 

JJJ 




EATraa SCAIF! FOR CLUTTER 


CRITERIA 

DESCHIPrr^/E PHRASE 

HATHCG 

Degree of sub- 
jective symbol- 
background 
clutter on 
specified 
display unit 

Completely uncluttered — e.g., 
only one pair of elements 

K1 

Mostly uncluttered — no con- 
fusing or distracting elements 

K2 

Some clutter — multiple ele- 
ments competing for attention 

K5 

Quite cluttered — difficult to 
keep track of desired quanti- 
ties among competitors 

Kk 

Completely cluttered — nearly 
impossible to tell desired ele- 
ments or quantities due to 
conpeting elements 

K5 

RATING SCALE FOR DISPLAY ATTENTIONAL WORKLOAD 

CRITERIA 

descriptive PHRASE 

RATHCG 

D1 

Demands on the 
operator atten- 

Completely undemanding and 
relaxed 

tlon, skill, 
or effort 

Mostly undemanding 

D2 

l-!ildly demanding 

B5 

Quite demanding 

; D4 

Conroletely demanding 

P5 


J 

J 


JJ 

WJ 

JJJ 


CoiitroXlsble mth difficulty or 5}:C2.5 (E©® 
high wor3d.oad_, 'but fair precision 


(3) * Raw data. 0 - Flight director situation. 
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favorable ratings for the MFD and a bimodal distribution of ratings for the 
HSI. The serious deficiencies in the HSI were noted in tracking curved paths. 
Comparison of the ratings for clutter shows a central tendency to recognize 
some clutter with multiple elements competing for attention in the HSI, 
whereas the ratings for the MFD are skewed more in the direction of an 
unfavorable appraisal of the clutter. Comparison of the ratings for display 
attentional workload shows more of a central tendency toward "quite demanding" 
attention for the MFD, whereas the ratings for the HSI tend to be slightly 
more unfavorable toward the "completely demanding" appraisal. 

In Table £0 we present summaries of the ratings by each of Pilots 1, 3^ 

4, and 6 during the second phase of the experiment emphasizing geographic 
orientation as well as tracking. A comparison of the two pages of Table 20 
shows a slightly less favorable central tendency in the ratings of the task 
controllability and precision when using the HSI, whereas the ratings are 
more uniformly distributed over four descriptive phrases when using the MFD. 
Ratings of task controllability and precision with the flight director in 
use are uniformly distributed over four descriptive phrases when using either 
the HSI or MFD. Comparison of the ratings for utility of status information 
between the HSI and MFD shows more favorable ratings for the MFD and a markedly 
\infavorably skewed distribution of ratings for the HSI which exhibits a mode 
beside the descriptive phrases: (Slf) "inadequate number of states .... " Com- 
parison of the ratings for clutter shows few differences in the tendency of 
both groups of ratings to centralize beside the descriptive phrase; (K3) 

"some clutter." Only one rating of the MFD was more unfavorable than KJ. 
Comparison of the ratings for display attentional workload shows a more favor- 
able central tendency beside the descriptive phrase: (D3) "mildly demanding" 

for the MFD, whereas the distribution of ratings for the HSI is unfavorably 
skewed with a mode beside the descriptive phrase" (Dt) "quite demanding." 

6. Pilot Comments 

All of the pilots have provided a great number of verbal comments in the 
course of the experiment. Therefore, we have provided in Appendix D an edited 
list of the comments offered by each pilot approximately in chionological 
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TABUS 20a 

SlMmY OF 5 EATINGS OF MED BY EACH OF PILOTS 1 , 3 , A, 6 DURING SECOHD PEIASE 

^ ^ ^ 

(Each Chock or Symbol Indicates One Rating by One Pilot) 


BAT3HG SCALE FOR UTILlTy OF STATUS mPORMATION 


RATIKG SCALE FOR CLUTTER 


Usefulness^ of the 
information sr^lied, 
on the specified dis- 
play unit, on the 
vehicle status — 
especially the rele- 
vant flight pat n 
vector states_, such 
as: altitude, speed, 

heading attitude, 
path error; etc. 


^Useful with respect 
to the mis sipn phase, 
task criteria, and 
operator's sense of 
vehicle safety. 


DESCRIPTIVE PHRASE 

RATING 

All desired states presented with 
adequate resolution and reada- 
hility 

SI 

Many of desired states presented, 
vd.th a few deficiencies in sca- 
ling, resolution, or readahility 

S2 

Some desired states presented, 
and/or some problems with sca- 
ling, resolution, or readability 

S3 

Inadequate number of states, or 
serious deficiencies in scaling, 
resolution, or readability 

Sk 

No direct status information or 
unusable 

S3 


JJJJJ 

JJJJJJJ 


Degree of suh- 
Jective Simbol- 
hackground 
clutter on 
specified 
display unit 


DSSCRIPTB/E PHRASE 

RAinTG 

Completely uncluttered — e.g., 
only one pair of elements 

K1 

Mostly uncluttered — no con- 
fusing or distracting elements 

K2 

Some clutter — multiple ele- 
ments competing for attention 

K3 

Quite cluttered — difficult to 
keep track of desired quanti- 
ties among conmetitors 

Kk 

Completely cluttered — nearly 
Impossible to teH desired ele- 
ments or quantities due to 
conpeting elements 

K5 


RATDJG SCALE FOR TASK COIITROLLABILITZ ALT) ERECISIOK 


RATING SCALE FOR DISPLAY ATTENTIORAL WORKLOAD 


CATEGORY 

CONTROLLABLE 

PRECISE 

Yes 

Yes 


No 

No 



DESCRUTIVE PHRASE 

RATING 

Very easy to control, with good 
precision 

CT 

Easy to control, with fair pre- 
cision 

C2 

Controllable, with inadequate 
precision 

C3 

Itoginally controllable 

Civ 

Uncontrollable 

C3 


operator atte 
tion , skill , 
or effort 


DESCRIPTIVE PHRASE 

RATING 

Completely undemanding and 
relaxed 

D1 

Mostly undemanding 

D2 

Mildly demanding 

D5 

Quite demanding 

• D4 

Completely demanding 

D5 


Controllahle with difficulty or if: C2. 5 ©CE® 

high workload, hut fair precision 


Raw data. © - Flight director and situation. 






[EABLE 20Td 

SUMMAEY OF 3 EATINGS OF HS I BY EACH OF PILOTS iy 3, 6 DURING SECOM) PHASE 

OF EXPERIMENT EIVEPHASIZING GEOGRAPHIC ORIE^ 

(Each Check or Symbol Indicates One Rating by One Pilot) 


EATHiff SCAIS FOR UTILITY OF STATUS THFORMATIOIT 


RATING SCALE FOR CLUTTER 


UseTulness®’ of the 
infonnation supplied, 
on the specified dis- 
play unit, on the 
vehicle status 
especially the rele- 
'<<rant flight path 
vectcr states, such 
as: altitude, speed, 

heading attitude, 
oath error: c-tc. 


^Useful with respect 
to the mission phase, 
task criteria, and 
cperatcr *s sense of 
vehicle safety. 


DESCRIPTIVE PHRASE 

RATHIS 

All desired states presented with 
adequate resolution and reada- 
bility 

SI 

^^any of desired states presented, 
with a fevr deficiencies in sca- 
ling, resolution, or readability 

S2 

Some desired states presented, 
and/or some problems with sca- 
ling, resolution, or readability 

. 

1 

Inadequate number of states, or 
serious deficiencies ini scaling, 
resolution, or readability 

Shr 

Ifo direct status inforination or 
unusable 

S5 

L_... 


JJJJJJ 


: 'background 
I clutter on 
specified 
display unit 


DSSCRIPTIVS PHRASE 

RATurc 

Completely uncluttered — e.g. , 
only one pair of elements 

KT 

Mostly uncluttered - — no con- 
fusing or distracting elements 

K2 

Some clutter — multiple ele- 

V-:; 

raentn corcpeting for attention 


Ciulte cluttered — difficult to 
keep track of desired quanti- 
ties among competitors 

Kh 

Completely cluttered — nearly 
impossible to tell desired ele- 
ments or quantities due to 
conpoting elements 

X5 


HATniG scale FOR TASK CONTROLLABILirY AIJD PRECIS ION 


RATING SCALE FOR DISPLAY ATTETITIONAL WORKLOAD 



5jc Controllahle vfith difficulty or ^ C2.5 (§0 
high vorklpad, but fair precision 



0 = Raw data. (g) = Flight director and situation. 






order. These comments are helpful in interpreting difficulties, pilot 
ratings and EPR data. They also suggest potential improvements to the dis- 
plays and controls . 

7. Eye-Point-of -Regard (EPR) 

This experiment has resulted in the acquisition of a large archive of 
high quality data with the STI Eye-Point-of-Regard System Model EPR-2, It 
remains necessary, however, to review the EPR data to gain -insight into a 
pilot's scanning process before encoding the fixation data for processing 
by a computer program to produce summaries of EPR statistics. For this 
reason, the raw data must presently be screened and digitized manually, which 
consumes a relatively great amount of time (and money). Under the present 
contract it will be possible to present EPR data for only 8 of 51 runs. Much 
more data are available for possible future reduction. 

The EPR data acquisition was confined to runs wherein both. HSI and MFD 

(as well as all other active displays and controls in the cockpit) were avail- 

able to the pilot. The reduced data to be presented are from the runs identi- 
fied in Table 21. 

Tables of statistics for the reduced EPR data are presented in Appendix E 

together with definitions of the properties of the raw and reduced data. 

For the reader who may be unacquainted with the motivations^ nomenclature, 
and uses for EPR studies in flight control and monitoring tasks, we have also 
included in Appendix F excerpts from Ref. 2 which provide essential background 
for interpreting EPR data and which help the interested reader to dig deeper 
into other references . 

¥e shall now proceed to review and compare plots of some of the EPR data, 
presuming that the reader is familiar with the material of Appendix F and at 
least the definitions of symbols and terminology in Appendix E. 

Plots of dwell fraction (DF) versus waypoint (¥P) intervals over which 
the data were averaged are compared in Parts ''a" of Figs. 20-25, Each part 
of each figure presents data for the EADI, HSI, and MFD so that direct com- 
parisons can be made between pairs of comparable runs with and without the 
flight director. 

TR- 1072-1 89 





TABLE 21. 

RIM 

IDERTIFICATIOR 

FOR THE REDUCED EYE- 

•POU^-OF-REGARD DATA 

RUN 


FLIGHT 


CASE 

FIGURE 

RUMBER 

PILOT PLAR 

LEVEL OF DISPLAY 

RUMBER 

RUMBER 

148 

5 

3 

Situation (raw data) 

301 

23, 25 

149 

3 

3 

Flight Director and 
Situation 

302 

23, 24 

154 

1 

3 

Situation 

301 j 

1 22 

155 

1 

3 

Flight Director and 
Situation 

302 J 


156 

1 

2 

Situation 

201 ] 
i 

j 21 

157 

1 

2 

Flight Director and 
Situation 

202 J 


261 

4 

2 

Situation 

201 ' 

1 

20 

257 

4 

2 

Flight Director and 
Situation 

202 J 



Plots of look fraction (LF) versus waypoint intervals are compared in 
Parts "b'* of Figs, 20-23. 

Plots of look rate (liR) versus waypoint intervals are compared in Parts "c" 
of Figs. 20-23. 

Plots of overall average scan rate (SR) versus waypoint intervals are com- 
pared in Parts ”d*' of Figs. 20-23, 

Plots of scan transition link fractions (TF) between primary displays are 
compared in Parts "e" of Figs. 20-23. 

Illustrative (typical) histograms of dwell interval on the three primary 
displays are confined to Run l48 in Fig. 24 and Run l49'in Fig. 25, because of 
the otheiwise unwieldy volume of histograms. The histograms for the HSI and 
MFD are helpiul in providing clues for possibly discriminating between roles 
for purely monitoring or for both controlling and monitoring, depending on 
the relative proportions of dwell intervals in the neighborhood of 0.25 to 
0.5 sec (monitoring) and greater than 0.5 sec (controlling and monitoring). 

[text continues on page 125] 
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Dwell Fraction Data for Runs 26l and 257 
Pilot k, Flight Plan 2 


Figure 20, Averaged Eye-Point-of -Regard Data for the Primary Displays 
by Waypoint Groups for Flight Plan 2 with Pilot If, Runs 26l and 257 
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STRA\<^WT VeC£l£miN6i 
DCCELCRATION 1 TURN 


b. Look Fraction Data for Runs S6l 


Figure 20 (Continued) 
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li TVRN A.T_;. . STRAI^H-^. „ F«KAl- 

/lOHSTAHt - DEtfiieRATm • TOILH _l A^O/yiil 
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c. Look Rate Data for Runs 261 and 257 
Figure 20 (Continued) 
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I 
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SJRAI^HX 
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fa-^w- 

^ FINAL 
APPROACH 


Scan Rate Data for Runs 261 and 257 


Figure 20 (Continued) 


TR- 1072-1 


94 





e. Transition Link Data for Runs 26l and 257 


Figure 20 (Concluded) 
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OPEN : RUN CA&E 201 (w/o Fl>) 
CL0SEP-. RUN 151 CASE 202 7WITHFP) 
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a. Dwell Fraction Data for Runs 156 and 157 


Figure 21 . Averaged Eye-Point-of-Regstrd Data for the Primary Displays 
by Waypoint Groups for Fli^t Plan 2 with Pilot 1, Runs 156 and 157 
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b. Look Fraction Data for Runs 156 and 157 


Figure 21 (Continued) 
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c. Look Rate Data for Runs 156 and 157 


Figure 21 (Continued) 
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d. Scan Rate Data for Rvms 156 and 157 


Figure 21 (Continued) 
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e. Transition Link Data for Runs l56 and 157 


Figure 21 ( Concluded) 
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a. Summary of Dwell Fraction Data for EADI, MFD, and HSI 
Pilot 1, Fli^t Plan 3 


Figure 22. Averaged Eye-Point-of-Regard Data for the Primary Displays 
by Waypoint Groups for Fli^t Plan 3 with Pilot 1 , Runs 15^ and 155 


'k o 


?L Rum J54 ^ 3o\ 

1 Run: IPS* > ^ foumf Ff> 




















o . j r 

-j -i I I 

w ■ :(•’•-•! •--: • 

: -4 -.- 


(- -^ . . l: 

|0 ! 

o NNFP ; 

A H5IJ 


. ■ r * - . ■ *• . 

154 , CA5C 30f /{A/o 
ClCG^: Ro'i /55“ ^ yXi pl> 




* I 

~ r ~ ST^UiHT, 
t „4 DESCEKlDlN^i 
LE4 


U-/5" 


/a -^21 


al -^A3L ^-^35 -35-^27 


DECELERA7»N4| FmA.U (i/A:aiMB»N6 PJRN TZ> ENTCR HDU?IN<^ 

TURN TO APPROACH ACCELERATING) HOLPIHC* HOLDING, PATTERN 
FINAL APP. LBdf PATTERN PATTERN 


b. SiJDimary of Look Fraction Data for EADI, MFD, and HSI 
Pilot I, Flight Plan 5 


Figure 22 (Continued) 
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Summary of Look Rate Data for EIADI, MFD, and HSI 
Pilot 1, Flight Plan 5 

Figure 22 (Continued) 


I-- 

1 : 

i* 

*■; ’ * ■ 
i: 

i ^ ’ 

1 . .u 

-::T 

1. 

LJi 

T 

r 

1 

•.J.i 

• T 

-■A 

—4- 

1 

—I- 

,..!4 

_i|. 


Hj; 

•1 

; ■ ■ • 

pel 







toi i-sioi- 

- 


.1 


OP^ V_. Rv^r^ 154 30\ (uj/o f>) 

cic^ep * jlofvi <r<^t (u)rt^ FI>) 


I i ' I ' r 


I , 

t' ■ i 



STRAI^jHT, 

OESCeNDlN<^ 

LE<5 




/5“ 15 


fd^ 3.1 


DECELERATiKli, FmA.L 
TURN TO APPROACH 
FINAL APP. 


3(~^a5. o?A-^35 


a/A.' CLIMBING,, TURNTi) EHTEK 

accelerating holding H0LP»K6» 

LEG PATTERN PATTERN 


HOLDING 

PATTERN 


d. Summary of Scan Rate Data 
Pilot 1, Flight Plan 5 


Figure 22 (Continued) 
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e. Sianmary of Transition Link Data for EADI, MFD, and HSI 
Pilot 1, Fli^t Plan 5 


Figure 22 (Concluded) 
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Figure 25. Averaged Eye-Point-of-Regard Data for the Primary Displays 
by Waypoint Groups for Fli^t Plan 3 with Pilot 3, Runs l48 smd 11*^9 
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b. Summary of Look Fraction Data for EADI, MDF, and HSI 
Pilot 5, Flight Plan 3 


Figure 23 (Continued) 
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c. Sianmary of Look Rate Data for E/U)I, MFD, and HSI 
Pilot 5, Flight Plan 5 


Figure 23 (Continued) 
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Pilot 5> Fli^t Plan 3 


Figure 23 (Concluded) 
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b. Waypoints 12 to 15 
Figure 2L (Continued) 
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c. Waypoints 15 to 18 
Figure 2i(- (Continued) 
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d. Waypoint 18 to 21 

Figure 24 (Continued) 
Il4 


7 


FREQUEHCY HISTOGRAM OF DWELL TIMES 


0 . Cl 00 
O .£50 
0.500 
0 .750 
1 . 000 
1 .£50 
1 .500 
1 .750 
£.000 


— ■ It It M n it » t.t •..* 

^ I*’*, I*'*, i***i r'^ i'\ »***! r 't t**'i t***i •“ T i' > *» 

t* •* »» •< 

.-1 wwv 

. *i I* *1 r'*i ••■'i * T t* ' »• T F t «■ '• » ** 

I It .« i. .* t. .* t. *v‘ *v"v* V y y 

5 r’’n"*'i 1^*1 »**• t**t I’T » *» * » 

1^* i''’» /'i ^"*1 i*‘*i •’’’t ** : 

4 « V V vy 

I 


EhPI 




0 . 000 

0 .£50 
0.500 
0 .750 

1 . 000 
1 .£50 




MFD 

II 


0 . 0 0 0 
O .£50 
0 .500 

0 .750 

1 . 000 
1 .£50 
1 .500 


t . t 


i‘**i ***** t* *'» ** ’• *"*• *’ 


• • ■ • 


e. Waypoints 21 to 22 


Figure 2k ( Continued ) 
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f. Waypoints 22 to 25 
Figure 24 ( Continued) 
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g. Waypoints 25 to 29 
Figure 24 (Concluded) 
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a. Waypoints 8 to 9 


Figure 25 . Frequency Histograms of Dwell Times for Run l48 
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b. Waypoints 12 to 15 


Figure 25 (Continued) 


TR-1072-1 


119 


FREQUEMCY HISTDGRfiM DF I'WELl 


TIMES 


0.000 
0.250 
0.500 
0 . 75 0 
1.000 
1 .£50 
1 .500 
1 .750 
2.000 
£.£50 
£.500 
£.750 
3 . 0 0 0 
3 . £50 
3 . 5 0 0 


0 .00 0 
0.£5 0 
0.500 
0 ,75 0 



0 . 0 0 0 
0 .£50 
0 .500 
0 . 750 
1 .000 



4 

t 


i ■ » V V'*/’*.:* V V V X !**•! X X 

WV W 

.•sJ-.A/'M ' . -i I It t« ‘ 


. .. .. It.. .1 »'.7^.‘*./VVWWV:'VX 

SKSxxSkKHKKKKKKXKXKXKKKKKKKX 


c . Waypoints 15 to l8 
Figure 25 (Continued) 
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d. Waypoints 18 to 21 


Figure 25 (Continued) 
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f . Waypoints 22 to 25 
Figure 25 (Continued) 
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g. Waypoints 25 to 29 
Figure 25 (Concluded) 
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Data for the five fixation points other than the three primary displays 
which were analyzed were not plotted hut are tabulated in Appendix E. These 
other five fixation points were the instantaneous vertical speed indicator^ 
the barometric altimeter, the airspeed indicator, the set of all fixations 
to the right of the primaiy displays (i,e., the STOLAED mode select panel, 
function switches, and engine instruments), and the set of all fixations 
above the primary instrument panel (i.e., the flight plan). 

We shall call attention to^ the following observations and possible inter- 
pretations thereof among the plotted data. 

a. With few exceptions there are relatively more looks at and 
longer dwells on the MED than the HSI. There are probably 
at least two underlying reasons for this: 

1) When using only raw situation data, it may be easier to 
close the heading loop with the relatively shorter and 
less frequent looks at the more familiar HSI, because 
the outer loop lateral as well as vertical position error 
signals are available on the HSI. 

2) When using the flight director, it may be easier to moni- 
tor the aircraft's heading and geographic position using 
the moving map display on the MPD, because the outer loop 
lateral and vertical position error signals can be moni- 
tored on the EADI with the flight director. 

A coimparison of Pilot 5's histograms (Pigs. 2k and 25) of dwell 
interval for Runs llt-9 (flight director) and lU8 (raw data) from 
Waypoints 18 to 29 (the missed approach, go-around, and holding . 
pattern) will illustrate the basis for both reasons above. In 
Figs. 25d to 25g (raw data) the HSI receives more looks than the 
MFD. Although the distribution of dwells on the HSI is weighted 
in favor of slightly shorter intervals, most of the dwells on 
the HSI exceed 0.5 sec for the purpose of control as would be 
expected. The characteristically slightly longer dwells on the 
MED in no way equalize the dwell fraction on the MED with that 
on the HSI (Fig. 23b) . In Figs . 24d to 2% (flight director) 
the MFD receives more looks than the HSI. The distribution of 
dwells on^the HSI is shifted to shorter values and truncated 
relatively more than on the MED so that the dwell fraction on 
the MFD exceeds that on the HSI (Fig. 23b). 

Most of the pilots said that they rarely used the heading tape 
on the MED, because it was so hard to inteip>retj and that they 
rarely monitored the numerical heading on the EADI, because they 
were unaccustomed to the form and location. However, an analog 
display of heading relative to course was provided in conjunc- 
tion with the moving map display on the MFD so that relative 
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heading could be checked within the same fixation during which 
geographic position was monitored on the MFD. 

One of the exceptions to Observation ”a” above may be found among 
the approaching Waypoints 8 to 18 for Pilot 5 in Run 1^4-9 with 
the flight director (Figs. 23a- 23c and 23© ). Here his dwell 
fractions on the HSI and MFD are con^jarable, but his transitions 
from the EADI to the HSI (and therefore his looks at the HSI) 
were more frequent from Waypoints 12 to 18 than were his transi- 
tions frcsn the EADI to the MFD. This observation is consistent 
with some of the preferential comments by Pilot 3 regarding the 
HSI when tracking curved or straight reference flight paths as in 
the approach. The dwell interval histograms in Fig. 24b from 
Waypoints 12 to 15 confirm that his number of looks at the MFD 
was about half the number of looks at the HSI and that the dwell 
intervals on the MFD were longer — in fact. Table E-4b (Appen- 
dix E) shows that his mean dwell interval was 1.2 sec on the MFD 
and 0.6 sec on the HSI between Waypoints 12 and 15, which accotints 
for the rough equality in dwell fraction on the IVLH) with half the 
look rate on the HSI. 

Another exception to Observation ”a" above may be found between 
Waypoints 9 and 1 1 for Pilot 1 in Run 1 57 with the flight director 
(Figs. 21 a- 21c and 2Te). Waypoints 9 and 1 1 define a l80 deg 
decelerating base leg txrrn to final approach course with glide 
slope intercept at the midpoint of the turn. During this turn 
pilot 1, who seldom ever looked at the HSI in either Runs 155 or 
157 with flight director, cast A looks at the HSI and A looks at 
the MFD with identical average dwell intervals (Table E-2b, Appen- 
dix E), and, therefore, identical average dwell fractions (Fig. 21a), 
look fractions (Fig. 21b), look rates (Fig. 21 cl, and transition 
link fractions (Fig. 21 e). Since Pilot 1 did not look at the HSI 
between comparable Waypoints 12 and 15 in Run 155, is difficult 
to draw a conclusion from these tvro counter-examples. Pilot 1 
always used the MFD in the heading-up orientation and never com- 
mented on feelings of disorientation during the base leg turn (as 
did Pilot 3) so it is unlikely that disorientation with the MFD 
would account for crosschecking the HSI during this turn in Run 157 
With flight director. A more likely hypothesis is that for cross- 
checking glide slope deviation between the EADI and HSI in the 
vicinity of glide slope capture through transfer of training, even 
though glide slope deviation is available from the "window" amidst 
the clutter on the EADI when using the flight director. Although 
Pilot 1 never commented specifically on any perceptual uncertainty 
associated with the window on the EADI, both Pilots 4 and 6 experi- 
enced difficulties of interpretation in using the window (see 
comments in Appendix D). 

b. Except for the glide slope tracking portion of Run 1 56 using Flight 
Plan 2 with only raw data (no flight director). Pilot 1 never looked 
at. the HSI, even for altitude-keeping. (The VDI on the HSI always 
displayed altitude error prior to capturing the glide slope.) 
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Instead, Table E-2a (Appendix E) shows that Pilot 1 preferred 
to use the customary barometric altimeter prior to glide slope 
capture* His comments indicate that he preferred the I'lF’D for 
3-ts curved cotirse predictor until he acquired the glide slope. 

c. In contrast, except for the holding pattern portions of Run 
using Flight Plan J> /vrith only raw data. Pilot 1 never looked at 
the barometric altimeter . Instead, Fig. £2a shows that Pilot 1 
spent relatively more dwell fraction on the HSI than on the MFD 
in the en route descent (Waypoints 8 to 9 ih Fig. 22a) followed 
by comparable but slightly more average dwell fraction on the 
MFD than on the HSI until well into the go-around. After that 
he Increased his dwell fraction on the MFD even more throughout 
the holding pattern. Although numerical barometric altifcu.de 
remained available on the MFD, in this instance, he began to 
look at the barometric altimeter only after he reached the 
holding fix. 

d. Except for the en route descent and go-around portions of Run lk8 
using Flight Plan 3 'With only raw data. Pilot 3 spent relatively 
more dwell fraction on the HSI than on the MFD even throughout 
the holding pattern. Table E- 4a (Appendix e) also shows that 
Pilot 3 i‘eferred consistently to the barometric altimeter through- 
out Run T 48 with a dwell fraction between 0.02 and 0.o4. 

e. Pilot 4 provided no exceptions to Observation %" above through- 
out both of his runs (26I and 257) using Flight Plan 2. When 
using the flight director. Pilot 4 never looked at the HSI from 
Waypoints 8 to l4 (from downwind leg throughout final approach). 

When using only raw data. Pilot 4 still spent relatively more 
looks at and longer dwells on the MFD than the HSI (Pig. 20a to 
20c, 20e). 

f. The overall scan rate as well as the individual look rates for 
Pilot 1 using Flight Plan 3 (Figs. 22c and 22d) are roughly one- 
half those for Pilot 3 (Figs. 23c and 23d). This is because ^ 
Pilot 1 spent a large amount of time looking at the EADI even 
when using only raw data, whereas Pilots 3 and 4 maintained more 
active scan patterns among all instruments. 

g. The overall scan rate decreases during the final approach among 
all 8 runs, viz. , Waypoints 1 2 to 1 4 of Flight Plan 2 and 1 2 to 1 8 
of Flight Plan 3. 

In conclusion, the reduced EPR data reveal that, with few exceptions 
(particularly in the case of Pilot 3)^ there are relatively more looks at and 
longer dwells on the MFD than the HSI when using raw data and especially when- 
using the flight director. This finding is consistent with the respective 
pilot comments and tends to confirm an expressed preference by Pilot 1 for the 
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MM) in curved path tracking and in negotiating holding patterns. While not 
definitive in the case of Pilot k because of the single flight plan for which 
his data were reduced, the EPR data from two runs also suggest a preference 
by Pilot k for the MFD in curved path tracking. In the case of Pilot 5 the 
EPR data suggest an equitable distribution of looks and dwells between the 
HSI and MFD throughout the approach with the flight director, but a prefer- 
ence for the MFD during the missed approach, go-around, and throughout the 
holding pattern in Flight Plan 5- In the case of Pilot 3 nsing raw data the 
EPR measurements offer little basis for inferring a preference between the 
HSI and MFD, because both horizontal displays are scanned, in turn, from the 
EADI fairly consistently throughout Flight Plan 3> except during the straight 
final approach where the HSI receives relatively more looks. 

I. SUMMARY OF RESULTS 

1 . On the basis of the blunder distribution alone from the simulation, the 
MFD seems to offer a worthwhile improvement in safety, since 15 of 20 
blunders among 1 60 runs involved runs wherein the MFD was not available 
to the pilot. Six involved runs with the MFD, but not the HSI, and only 
one involved a run with both. The blunder distribution provides a quan- 
titative basis for answering the first two questions which were posed 
in formulating the scenario, viz. , 

• What is the degree of improvement offered by the moving 
map display (MFD) over the HSI as a function of pilot 

• When is a moving map display essential for safety? 

The numerical value of the blunder-to-run exposure ratio was 0.1 1 for 
the MFD in both the first (tracking) and second (geographically orienting) 
phases of the experiment, whereas the similar ratio for the HSI increased 
from 0 . 1 4 in the first to O.k in the second phase, which involved an 
increase in radio navaid/oriontation workload. The numerical values of 
this particular ratio thus afford measures of the relative improvement 
offered by the moving map display (MFD) over the HSI as a function of 
the increase in pilot workload in the second phase of the experiment. 

The ratios also suggest (by their greater disparity) that the moving 
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map was more essential for safety in the second phase of the experi- 
ment (involving missed approaches and holding patterns ) than in the 
first phase (involving purely approach tracking). 

2. The flight director provides for more precise tracking of the assigned 
altitude and the glide slope than otherwise. However, there is no 
consistent evidence of marked differences between tracking errors with 
the HSI versus the MFD among the five practiced pilots who participated 
in the simulation. There are instances where altitude-keeping was more 
precise with the MFD when using only situation data. (This may be because 
ready interpretation of the MFD leaves more time for attention to altitude 
tracking. ) 

3. The null hypothesis of equality between average excess control capacity 
within comparable pairs of fli^t plan waypoint groups using either the 
HSI or the MFD arrangement was tested for signifiGant differences. The 
results show that the null hypothesis was rejected for 27 of 38 pairs 

of comparable waypoint groups at the 0.05 level, where 0.05 is the proba- 
bility of rejecting' the null hypothesis when it is true. Of these 27 
rejected pairs, the MFD exhibited greater average excess control capacity 
for 16, and the HSI greater for 11 pairs. 

k. The null hypothesis of equality between average excess monitoring capa- 
city within comparable pairs of runs using either the HSI or the MFD 
arrangement was tested for significant differences. The results show 
that the null hypothesis was rejected for 1 5 of 38 pairs of comparable 
runs at the 0.05 level . Of these 13 rejected pairs, the MFD exhibited 
greater average excess m.onitoring capacity for 10, and the HSI greater 
■for 3 pairs. ’ : 

5 . The pilots provided subjective ratings of (a) task controllability and 
precision, (b) utility of status information, (c) symbol-backgro\md 
clutter on the display, and (d) display attentional workload each on 
five-point descriptive scales. Summarized comparisons of all ratings 
f^^ the MFD and the HSI in each category follow. 
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a. Task Gontrolla'bility and Precision . There is a slightly 
less favorable central tendency to rate the HSI "control- 
lable, with inadequate precision," in tracking curved paths 
in the presence of wind, whereas the ratings favor the MPD 
as "controllable, with fair precision." Ratings with the 
flight director in use are uniformly distributed over four 
descriptive phrases from "easily" to "marginally" control- 
lable and exhibit no central tendency with either HSI or 
MFD. 

b. utility of Status Information . The MFD received more 

favorable ratings than the HSI. Ratings of the usefulness 
of information supplied covered the three adjectives 
"adequate" some" : "inadequate" in the ratios for 

the MFD and k; 2:5 fo^^ the HSI. The bimodality of ratings 
for the HSI is believed to be associated with the favorable 
view of the HSI for tracking rectilinear flight paths and 
the unfavorable view of the HSI for maintaining geographic 
orientation while tracking curved paths in the presence of 
wind. 

c. Clutter . Ratings of both the HSI and MFD as having "some 
clutter"' predominate, but there is a slight tendency to 
rate the MFD less favorably. 

d. Display Attentional Workload . Ratings of the MFD show a 
central tendency between "mildly" and "quite demanding," 
whereas ratings of the HSI exhibit a less favorably skewed 
mode between "quite" and "completely demanding." 

6. The reduced eye-point-of-regard( err) data for 8 runs among Pilots 1 , 
and k reveal that. With few exceptions, there are relatively more 
looks at and longer fixation dwells on the MPD than the HSI when using 
raw situation data and especially when using the flight director. This 
finding is consistent with the comments by Pilots 1 and k and tends to 
confirm an expressed preference by Pilot 1 for the MFD in curved path 
tracking and in negotiating holding patterns. While not definitive 
in the case of Pilot k because of only a single flight plan for which 
his data were reduced, the EPR data from two runs also suggest a prefer 
ence by Pilot k for the MFD in curved path tracking. In the case of 
Pilot 5 the EPR data suggest an equitable distribution of looks and 
dwells between the HSI and MFD throughout the approach with the flight 
director, but a preference for the MPD during the missed approach, 
go-around, and throughout the holding pattern in Flight Plan 5 . In the 
case of Pilot 3 using raw data, the EPR measurements offer little basis 
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for inferring a preference between the HSI and MID, because both hori- 
zontal displays are scanned, in turn, from the EADI fairly consis- 
tently throughout Plight Plan 3 ^ except during the straight final 
approach where the HSI receives relatively more looks. Direct cross- 
checking between HSI and MFD is rare, but such scan transitions are 
predominantly unidirectional from HSI to MFD by Pilots 1, 5, and k when 
using raw situation data. 

7. All of the pilots provided a great number of helpful supporting comments 
in the course of the experiment. Several recommendations for specific 
STOLAND display modifications are ' based on the pilot comments. There 
was a consensus among the pilot comments which acknowledged the excel- 
lence of the HSI for tracking rectilinear inclined courses, yet recog- 
nized the superiority of the existing MFD for maintaining confidence in 
geographical orientation while tracking curved approach courses and 
establishing holding patterns in the presence of wind. This consensus 
provides an answer to the third question posed in the formulation of the 
scenario, viz., 

• Can the MFD replace the HSI or is it strictly an addition 
to the existing panel? 

The evidence is against its equivalence as a replacement in its present 
form. 

8. Based on the review of the STOIAND display content in Section II, we 

gave a preliminary answer to the fourth question posed in formulating 
the scenario, viz., ' 

• What is the minimum display content required to make the 
MFD a useful display? 

As a result of the simulation and the pilot commentary therefrom, we 
revise the list of information given to exclude the heading tape and 
substitute the course/heading vector, so that the complete list will 
include barcanetric altitude, present time, the uncluttered terminal area 
map, the selected flight route, the aircraft symbol, the trend vector, 
the course /heading vector, the next waypoint and its commanded altitude. 
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A suimtiary of specific, significant recommendations for STOLAUD display 
improvements, based on pilot comments, is presented at the conclusion 
of Appendix D. 


SECTION IV 


CONCEUSIONS 

A sophisticated set of measurements has "been made to compare a moving 
map display (MF'D) with a conventional horizontal situation indicator (HSI). 
The measurements included: 

• Tracking performance 

• Excess control capacity 

• Monitoring capability 

• Pilot ratings 

• Eye-point-of- regard statistics 

In addition, the incidence of ’’hlunders” and specific pilot comments were 
recorded. 

The displays were compared in simiilated operation of the Augmentor Wing 
Jet STOL Research Aircraft (AWJSRA) involving the tracking of courses and the 
execution of complex procedures. 

All the measurements were consistent with each other and with the pilots' 
verbal comments. With a single very minor exception, in every case in which 
the two displays could be compared, either there was no difference between 
them, or the evaluation favored the MFD . (The minor exception to this state- 
ment involved a very slightly worse pilot rating of the ^mlity of ’’clutter, " 
on the MFD. ) 

Otherwise , conclusions drawn from the measured results and experience 
in the conduct of the tests are as follows. ; 

1 . Combined use of both displays represents a significant contribution to 
; safety. . ; 

2. The present foim of either display can be in^roved. 

5. There is little evidence for the use of the MFD as a tracking display, 
whereas the HSI is definitely considered by the pilots as a tracking 
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display. The first phase of the exp)eriment^. confined to the tracking 
of reference flight plans^ provided a comparison of the EADI (supported 
hy MFD) with the HSI (supported by the SADI). The emphasis of the 
second phase of the experiment was changed to compare the HSI and MFD 
as they provide confidence and precision in geographic orientation 
problems rather than tracking problejas. Among the missed approaches 
in this phase of the experiment there is evidence in the eye-point-of- 
regard data and the subjective ratings that the MFD was preferred by 
all of the pilots. 

k. The combinations of two and three primary displays tested offer com- 
parable performance, safety, and workload on straight courses among 
waypoints, but in flying curved coxirses in the presence of wind, pilot 
confidence is better and subjective impressions are that workload is 
less demanding when using the MFD and the EADI rather than when using 
the HSI and EADI i Among the significant differences in measured excess 
control capacity during tracking, the MFD exhibited greater average 
excess control capacity in a slight majority of comparisons. 

5 . The caution advisory response task for measuring excess monitoring 
capacity was learned reasonably well by the pilots. There is, however, 
little consistent evidence of differences in response times attributable 
to the HSI versus the MFD in monitoririg reference flight plans. Among 
the minority of significant differences in measured excess monitoring 
capacity throughout the experiment , the MEFD exhibited greater average 
excess monitoring capacity in a majority of comparisons. 

6 . The flight director improved error performance much more dramatically 
than did the MFD when Compared with the HSI ttsing the raw data .Even 
with the flight director, however, intense concentration is required 
when using the ESI alone to keep track of closely spaced waypoints [i.e., 
less than 2.8 km ( 1 .5 nm) apart], bixt -good , p«?rformaace results as long 
as the flight director is available . 

7. HSI Bearing Pointer No. 2 alerts the pilot to turns, and cvirved courses 
can be flown with the HSI in prevailing winds using the reference flight 
path mode of STOLAND. However, pilot acceptance is inferior, and the 
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HSI requires intense coneentration when flying curved paths without 
the flight director, because it provides no counter (like that on the 
MFD) to keep track of waypoint numbers, and there is no coordinated 
bank angle/course predictor to help in anticipating the effects of 
wind on curved courses. 

8. The MFD course predictor offers a useful bank angle director for cirfved 
paths and for turns between straight segments in the presence of wind. 

All of the pilots learned to use this successfully. However, the MFD 

is not the only possible display for the presentation of a course direc- 
tor for setting bank angle. For example, a curved course bank angle 
director could be incorporated within coordinated heading and roll 
scales on the EADI as reconimended in Section II. It is possible that 
this would be a more cost-effective backup for the flight director for 
tracking curved courses and reference flight plans because such a presen- 
tation on the EADI would be better integrated with the flight control 
tracking information than is the course predictor on the MFD. 

9 , The reference flight path mode of the STOLAED system makes it as easy 
as radar vectoring or area navigation (RHAV) to follow a standard ter- 
minal arrival route, but the MFD contributes more confidence at a 
glance, whereas the HSI requires intensive scanning of EMB and the 

• bearing to the waypoint, and mental coordination with the chart, in 
order to keep track of position. When coupled with the reference 
flight path mode, the HSI is recognized as a good rectilinear course 
tracking display by most of the pilots who are familiar with its format* 
Therefore, in the reference flight path tracking mode, the HSI appears 
as a more cost-effective raw data backup for the flight director, pro- 
vided a waypoint counter is incorporr.ted within or near the HSI. 

1 0. The clarity of heading presentation on the HSI is considered superior 
to that on the MFD by all of the pilots who commented on that feature . 
The lubber line on the MFD is relatively invisible, and the rectilinear 
format for heading on the MFD is apparently contrary to the compass rose 
stereotype to which the pilots are accustomed (or prejudiced). 
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11. Although the MPD does not appear to he essential for tracking refer- 
ence flight plans, if the pilot ever deviates far enough in course 
and altitude to saturate the presentation on the HSI, he is then 
left to depend on relative bearings and DME to maintain his geo- 
graphic orientation. Of course, he should have been monitoring his 
bearings and DME all along; however, the HSI requires much more 
intense concentration than the MFD in order for the pilot to orient 
himself geographically. Therefore, the MFD with its moving map is 
much more forgiving of pilot distractions in providing him with geo- 
graphic orientation at a glance. It is this use of the MFD in providing 
geographic orientation when a pilot is not tracking a reference flight 
plan which all of the pilots seemed to value most during the second 
phase of the experiment. (This involved negotiating missed approaches, 
go-arounds , and holding patterns while changing radio navigational 
aids). 

12. A measure affecting safety, the relative proportion of blunders per 
"flight" in the simulation, remained approximately constant between 
the two phases of the experiment, i.e., tracking and geographic orien- 
tation, when the MFD was used. However, when the pilot workload was 
increased in the second phase of the experiment by introducing navi- 
gation problems associated with the missed approach (which may tend to 
disorient the pilot geographically) , the relative proportion of blunders 
per "flight" increased adversely when the HSI was used with the flight 
director. Under these circumstances, the MFD alone appeared to; offer a 
measurable contribution to flight safety. 

15. During training it was discovered that the MFD was necessary for ensur- 
ing capture of the reference flight path, even though the initial condi- 
tions were favorably prealigned. If we had not used the MFD for initial 
capture, we would have experienced an excessive number of aborts and 
restarts. This may have been caused in part by excessively stringent 
capture criteria in the STOLAND software . It happened to be a lot easier 
to use the MFD for capture (and then to cover it if we were testing the 
HSI alone) than to alter the capture criteria in the STOLAfJD software. 
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lit. Setting up STOLAWD to capture a reference flight path even with a 
favorable initial condition provided the pilot with a secondary 
button-pushing task of considerable difficulty at first ^ although 
the pilots eventually learned to do it in about a minute's time by 
repetition. The administrative keyboard and mode selection acti- 
vities required by STOLAEID represent work with which a copilot . 
should be helping in the aircraft. The addition of a copilot's 
station to the STOLAND simulator should be considered. 
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APPENDIX A 


PROSPECTUS OF MANUAL CONTROL TECRNICpBS 


Table A-1 presents a prospectus of longitudinal and vertical multiloop 
manual control techniques for the Augmentor Wing Jet STOL Research Aircraft 
in terms of limiting forms of multiloop transfer functions with Bode and 
complex root loci based on Pigs. 1 through i|- in the text. Section II. Two 
flight conditions are illustrated, one on the "backside" and one on the 
"frontside" of the thrust-required curve. The necessary coupling numerators 
listed in Table A-fi are based on the longitudinal dimensional stability 
derivatives in Appendix D of Ref. 6. Other necessary numerators are provided 
in Appendix D of Ref, 6. The numerators used here are computed without the 
pitch SAS so as to provide a more critical appraisal of manual control tech- 
niques and STOLAND displays, if the pilot be required to take over and 
complete the short approach in the event of an automatic system failure. 


Annotated views of each of the primary STOLAND displays are presented 
in Figs. A-1 through A-5, and an illustration of the STOLAND simulator 
instrument panel appears in Fig. A-k, 

In the lateral- directional axis. Appendix E of Ref. 6 pr es ent s only 
dimensional stability derivatives and transfer functions Which include the 
effect of the (lateral- direct tonal) SAS below 51 m/s (TOO kt). (The lateral 
SAS is not operative above 51 m/ s. ) Consequently, the effect of the SAS 
cannot be removed for our purpose here. 


In all four flight conditions from 72 m/s ( 1 40 kt ) to 3 1 m/s (60 kt) 


in Appendix E of Ref. 6, the dutch roll oscillatory mode and the complex 
roll attitude numerator zeros for a lateral wheel input are nearly identi- 
cal. This indicates negligible excitation of the dutch roll by wheel inputs. 
Consequently, for our purposes the augnented roll attitude response transfer 
function for a wheel input is well represented as: 


9 . 0.6 

a{8+1.6) 


(A- 
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TABLE A- 1. PROSPECTUS OF MAUUAL CONTROL TEGMIQUES 


tE^THlG KmH OF 
I^ULTILOOP raAHSFER 
MCTIon FOR 
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GLIDE SLOPE 
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VITll VERU- 
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VERTICAL Close 
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FEEHBACK ^ 


Olf FINAL APPROACH AT ft) kt ON 7-5 deg GLIDE SLOW 
LIMITHfO FORMS OF TRANSFER FUNCTIoriS SODE AND COMPLEX HOOT LOCI 
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f> T __ -Zfci8 'r^ (o.6ei4^ 

i ^ Jj^ uir ” [0.84 } 0.74] 
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i“rL, 


Transfer f^inctions are defined in simplified form, as follows, (s + a) => (a)- [s^ + 2^cos + np] => [^; O)] 
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Figure A- 1. Annotated View of EADI for STOLAND 
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Figure A-3 . Annotated View of MFD for STGLAIfD 




Figure A-4. STOLAND Simulator Instrument Panel 
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TABLE A- 2. SAS - OFF LONGITUD INAL COUPLING NUMERATORS 
(Based on Appendix D, Ref. 6 , assuming Mqj = Xsgi = O) 

A(s) A(s +a)j A[s^ + 2^cos +cjD^] A[^, to] 


SYMBOL 

51 ni/s (60 kt) TAS, 7 i = 7*5 deg 

46 m/s (90 kt) TAS, 7 i = 0 

«6e5T 
rrh U 

N§T6e 

■ i 

-0.231(0.00144) m/s-rad 
-0.759(0.00144) ft/sec-rad 

0.0719[0.0951, 6 . 854 ] m/s-rad 
0.256[0.0951, 6 . 854 ] ft2/sec2.rad2 

"-0,188(0,72) m/s-rad 
"0.617(0.72) ft/sec-rad 

0 . 682 ( 7 . 32 l)(- 5 . 408 ) ra2/s2-rad2 
2 . 236 ( 7 . 321 )(-5.408) ft2/sec2-rad2 


over the airspeed range for terminal area operations. The value of Lg^ 
increases to about 1 .o/sec^ at 46 m/e ( 90 kt). This variability in Lg^ 
will affect only the estimated pilot gain in the roll attitude loop describ 

ing function y^n in Fig. 5 in the text, fJection II. Likewise, the varia- 

■m 

bility in 1 /Tr is small; 1 /Tr increases only to 1 .85 rad/sec at 90 kt. 
Since the effect of the SAS is implied in Eq. A- 1, we shall adopt the SAS 
as a surrogate for the pilot' s rudder closure implied in Fig. 5* 

The closed loop roll attitude transfer function based on Eq. -A-1 is 
therefore well-represented by 

'P . ^Pcp^^w 

, . % s2 + ^ + ^ 

The pilot can easily provide modest lead- lag equalization in in the 
frequency range beginning at and extending above 1 /Tr to offset his time 
delay and to increase the effective bandwidth of the roll attitude closure 
which is bounded from above by l/2i^ at values of pilot gain which provide 
critical damping of the roll response. The combination of the effect of 
the pilot * s lead- lag equalization and time delay re can be approximated as 
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^ Kcp(l + Ijis) 

“ (1 + Trs) 

where - , 1 

% - 


(a-5) 


Therefore, with the substitution of Eq. A-3, Eq. A-2 becomes approximately 


kJl5w(s + :^) 

(A-ll-) 

(s + ^)[s2 +^s + 

where 

Thus, the effect of the. original rolling: subsidence, l/Tg^, is suppressed. 

How it is reasonable for the pilot’ s gain to be adjusted so that 

> l/2Tg > 1 rad/sec. Then the closed loop roll attitude response 
ratio cp/cpj _2 will approach a limiting value, of unity at lateral path con- 
trol frequencies which are much less than 1 rad/sec — on the order of 
0,2 rad/sec, and we can replace Eq. A-^t- by the value cp/cpic = 1 for the 
purpose of represehting the course angle and lateral deviation closures 
in Fig. 5. 




The course angle can be expressed with good approximation as 


1 _ I§ 

UqS Uq 


(A -5) 


and the lateral deviation error in all modes except the ref erence fli^t 
path (EKAV) mode as 

In the EHAV mode, the displayed lateral deviation error is 


ye 


yr 


UqX 

s 
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Consequently, in all except the MDDILS mode, the pilot’s internal roll 
command, in Fig* 5 , will he 


CD. ^ Y y — Y ilf 

^xc % ® Pllf 


where the heading deviation is given hy 


(A- 8 ) 


(A- 9 ) 


and the describing function Ypy = Yp^/R in all except the ENAV mode. In 
the MODILS mode, the pilot’s internal roll command, c(jj_Q in Fig. 5 , will 
be 


9 ic ~ T! Ye ^p-s^ 


(A- 10) 


If the gain variation with range- to-go, R, is removed (or ignored as 
when fixed-gain conditions are assumed), Ypy s Yp^/R regardless of the 
mode, and Eq. A -5 through A-10 can be combined on the basis of Laplace 
transformation to form the closed loop lateral deviation error: 


ye(s) = 


+ %)8\ , , / 

Uj + (s + - 

s2 + — 5- s + YpyS 


IVcr(s) 


(A- 11 ) 


Equation A-n can be specialized for each mode with the aid of Table A-3. 

TABLE A-3 ; LATERAL-DIRECTIORAL PILOT DESCRIBING 

FOR EQ,. A-ri BY NAVIGATIOR DISITAY MODE^^^^ 


MODE 




RNAV 

>0 

= 0 

Independent of R 

TACAN 

>0 

==0 

Itpe/K 

VOR/ILS 

> 0 

= 0 


MODILS 

= 0 

> 0 

^Pc/® 
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The implications of various forms for Yp^, ^P>.^ Yjy on steady- 
state errors are discussed in Ref. 3. The closed loop unda-.red natural 
frequency of course- following in Eq. A-n will he ^Yp^g, and the damping 
ratio will he (Yp^ + Ypj^)i/g~’/2Uo,yY^. A closed form solution Of Eq. A-5 
through A-]0 in terms of Bessel functions is given in Ref. 13 for the cases 
where the range R is allowed to vary e3q)licitly as a function of time with 
a constant ground speed. 
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AFFMDIX B 


STOLMD SIMULATOR MODIFICATIONS FOR SECONDARY TASKS 
INTRODUCTION 

As part of Contract NAS2-8975, it was desired to implement the following 
additions to the STOLAHO/Augmentor Wing simulation. These changes were used 
in an experiment involving the Digital Integrated Simulation Computer (EAI 
8i|-00). The additions consisted of: 

• A cross-coupled secondary control task 

• A reaction time side task 
These tasks are described more fully below, 

CROSS-COUPLED SECONDARY CONTROL TASK (CCSCT) 

The basic concept was to introduce an unstable spiral mode into the 
pilot's lateral control task. The degree of instability was controlled 
by the pilot's performance in regulating aircraft position and airspeed. 

The parameter X (spiral mode pole) was varied according to the scheme 
shown in Fig. B-1. 

In Fig. B-1 the inputs are labeled as ey (vertical position error), 

^ (lateral position error), and e^g (airspeed error). We defined ey and 

e^ as the vertical and lateral deviations of the path deviation window 
h 

from the center of the EADI screen. The term e^g was defined as the dif- 
ference between the airspeed commanded by STOLAMD and the actual aircraft 
speed. Note that we computed ey, ejv, and e^g regardless of whether or 
not the path deviation window was actually being displayed on the EADI. 

After the errors were processed by the washout and the absolute value 
blocks, we displayed them on a strip chart recorder and computed the 
average values in the 8400. The symbol E is meant to imply the average 
calculation . At the end of each run the average errors were printed on 
the lineprinter . 
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Figiire B-T. Block Diagram of Cross- Coupling Computation for Secondary Control Task 













The switch, S2^ was located on the computer operator's console with a 
light to indicate its status (light on for S2 on). 

The block labeled "integrator and output limiter” in Pig. B-1 needs 
ejcplanation in order to distinguish it from an integrator followed by a 
limiter. The desired logic was achieved with the following FORTRAN 
statements. 


where 


XLAM=XLAM+XLAMD* TP 

IP( XLAM . GT . XLAMAX) XLAM=XLAMAX 

IF( XLAM.IT. XLAMIN)XLAM=XLAICra 


XLAM 

XLAMD = 
TP. 

XLAMAX = 
XLAMIN = 


X (Fig. B-1) 
X (Pig. B-1) 
frame time 
maximiim X 
minimum X 


All of the logic in Fig. B-1 can be placed in the slowest con^juter loop 
of the airframe simulation. 

Figure B-2 indicates how the X resulting from Fig. B-1 is used in the 
cross-coupled secondary control task (CCSCT) . This figure is best under- 
stood by realizing that it depicts a model- following scheme with switch 
SI controlling whether the aircraft model or the CCSCT is controlled by 
the pilot . 

If SI =1, the wheel input (&w) commands some bank angle (cp|) from the 
aircraft model, the Kg feedback loop around the CCSCT is engaged (thus 
stabilizing that element), and the output of that loop (^ 2 ) tracks cp'j . 

When Si is switched to zero, the wheel input drives the CCSCT (with 
the Kg loop disengaged), and its output (cpg) is fed through lead- lag 
compensation to drive the aircraft response to match it. Again, q>i = <P 2 . 
Note that at the moment of switching, no bank angle transients occur since 
cpi = cp 2 regardless of the position of S^ . 


X (from Fig. B-1 ) 


IMCAB SI ' ' \0T 

YDPHI 


-wr- to aircraft 


U4L 

(Ts-t-1) 

DEHI 

0 

(TgS + 1 ) 



to EADI 


EHI3 


PHI 


SI 


tp^ from aircraft 


41 


0 


nOTE: Switch Si controlled, from cochpit 

with status light 

See Table B-1 for values of constants 


Figure B-2. Model-Followltig Block Diagram for Embedding Secondary Control Task 
Within the Roll Axis and Spiral Divergence of an Aircraft 











Svfitch SI was placed on the computer operator’s console together with 
its status light (light on when SI = O). An event marker on the strip 
charts indicated the status of SI . 

The logic shown in Fig, B-2 was included in the computer loop which 
nonnally handles pilot wheel inputs. 


A list of values of the constants used to mechanize the CCSCT is given 
in Table B- 1 . 


SSACTION TIME SIDE TASK 


This task was designed to measure the pilot’s simple reaction time under 
various conditions. To do this, vre randomly lifted a caution light in the 
cockpit and measured the time required for the pilot to respond by pushing 
a designated button to extinguish the light. The response button was iden- 
tified as such among the group of ten buttons on the center console. 

The algorithm for randomly turning on the caution light was as follows: 
Caution light initially off. 

Given the input constant 0 = Mean Time Between Caution 
Advisories in seconds, compute 


h 


% 

-g- where Tp 


frame time (sec) 


Each frame time generates (from a uniform distribution) 
a random number (x) between 0 and 1 such that 

if 0 < X < h caution lij^t on 

if h < X < 1 no change in caution light 

When the caution light comes on, _disable the above test and measure 
bhe time until the response button is pushed. 

When the response button is pushed, extinguish the caution light and 
enable the test again. 

We stored the response times for each run and printed them at the end 
of each run along with the average value. 

B-5 
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TABLE B -1 

NUMERICAL CONSTANTS FOR SECONDARY TASKS 


SYMBOL 

VALUE 

UXJ 

0.05 rad/sec 


0.03 rad/aec 

“AS 

0 . 1 rad/sec 

% 

1.0 

Kl 

1 .0 

Kas 

0,1 

E2 

Unloaded value of Eg for each 
pilot and waypoint group 

Ec 

1.1 

% ■ 

0 :. 02 , 

• 

^max 

0.05 rad/sec 2 

• 

5^111111 

-0.05 rad/sec 2 

XlC 

0 

J^max 

0.5 rad/sec 

^min 

0' : ; 

DZ 

Corresponded to two halves of 
lateral displacement window 
width on EADI or two dots on 
HSI course deviation scale 

% : : 

0.062 sec 

% 

0 

Kg 

V- 5.25’ : V 


: ■ 0.19 : V- 


0.625 sec 




0.625 sec 


0.1 sec 


48 sec 
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-3 

Since 0 was 48 sec, h was on the order of 10 . This might cause some 

problems if the random number generator did not produce a sufficiently 
uniform distribution. 

A switch was provided on the computer operator's console to turn the 
reaction time side task on or off and a light indicated when it was on. The 
task was put in the slowest computer loop. 

Table B- 2 provides a sample of the performance data format provided 
by hard copy from the EAI 8400 line printer for one of six waypoint groups 
throughout each run of the simulation. , 
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TABLE B-2. SAMPLE COPY OF FLIGHT PERFOEMANCE AND ACCEPTANCE FORMAT 


* ' 

« C/8 aUG wTNU 

♦ RUN number* 


' * • * * 1 

SIM-P'LT lata SUMf^A»<T KKtJpRAl-l NAHtT*’ * 
CASE NUMBtK»20l P4L9T NUuRFRa 1 OA.TE U2/24/A6 * 

l**«***4>« 


FR9M wPT P 10 '^PT 11 time rW-^M 22*22*33. "5 22*23*32 * 

INT. TIME 59.7 SEC UMLftAutn ERRpH o'.,80 Ec.-!./ * 





NUMBER 

LATA POINTo 

SAMLto , 

321. 

0 



VARIABLF 

MAy 

TIME 

min 

time 


MEiW 

STD DEV 

UNITS 

LAT POS ERRftR.. 

0..440 

22*22*45 

-0.240 

22*22*50 


0^117 

0.194 

IN 

vert POS ERp8R. 

0.360 

22*23*21 

-0. 110 

22*23*3? 


0,173 

0,108 

1 N 

I A S R ^ 0 R • • ^ • 

8.100 

22*23* 7 

-10,500 

22*22»3q 


0^ 4 

5,785 

KNOTS 

PITCH A T T\ # ^ ♦ 

10,432 

22*22*34 

-1.021 

22*23* In 


5,242 

3.570 

DEG 

AL^A 

16.707 

22*23*1 1 

3,947 

22*22*4? 


9.705 

2,611 

DEG 

VERT F.P, AkiGLE 

2.189 

22*22*34 

-13.016 

22*23*11 


-4,449 

4.299 

DEG 

beta,., 

11. 092 

22*23*13 

-12,609 

22*23*20 


-1,3.11 

4.611 

DEG 

*>S1 ........... . 

1P6.323 

22*22*33 

15,615 

22*23* 1 4 


09,315 

60.789 

■ deg' ■■ 

PM 1., 

16.040 

22*23*25 

-35,092 

22:23* c 


-11,107 

12.502 

DEG 



LAT POS EkROP ♦MEA.^ 

ABSOuuTf 

WASH 

OUT . 

0.1658 




VERT POS 

error *meAi'I 

ABSOluTf 

wash 

OUT * 

0,1269 




IAS ERR9R 


APSOUUTP 

WASH 

OUT * 

3,2446 




U4« * 

M£AN * 

O.UvJ 

» StD DEV * 

0.110 



MUMRtR OE DATA POINTS SAMLED , 321. C 


MEAN ANJ standard DEVIATION Or TURBUlEnCE COMPSNEvTS 
VAPlAbUt mean unit? STD DEV IJVTTS 




PMP yTUK-i 
PMS vyUKa 
PMS WTUKd 


4,2666 FT/SEC 
-0.65^7 FT/SEC 

1.2541 ft/sec 


1.369J FT/-»EC 
1,6840 FT/$EU 
2.4201 FT /SEC 


I -slot -HI 


TABLE B-2 (Concluded) 


* C/8 iUG **INU 

♦ RUN NUMBfR » 93_ 


SIM.FLT DATA SUMMArtY PkORRAH N AME , , , H» I * 
CASE NUMBEK«201 P i!J)T _NUil8r D A TE 02/24/A6 * 


*■, 

* 


FR9M HPT 9 . » D '*'PT 1 1 

I NT, time S9.> sec 


TIHE rR!*M 22,|,22*33_ 22»:?3:3?; 

UNLOAofcn ERR9P O^AO 


■*- 

* 


VARI ABL E 


MAy 


NyMBER 9F DATA_ POINTS SAMLtiJ j, 321,0 
TIME MIN time 


MEAN 


STD DEV 


UNITS 


w 

I 

>0 


VERT velocity,. 

6^055 

22122134 

-31.369 

22*23*11 

-10,740 

10.121 

FT /SEC 

normal ACCEl,. . 

5.380 

22 S 22 *45 

-6.731 

22»23«12 

- 0,775 

2.133 

FT /SEC 2 

LONG ACCEL,,... 

6.264 

22*22*34 

-0,660 

22 *23* 5 

2,538 

2.025 

FT /SEC 2 

L AT ACCEL...... 

3.528 

22*23*29 

-4,005 

22*23*13 

0,179 

1.355 

Ft/SEC2 

LAT F.P, angle. 

179.702 

22*22*37 

-179,965 

22*22*36 

79,244 

8 1 • 5 6 3 

DEG 

L AT velocity... 

160,168 

22*23* 3 

15 , 826 

22* 22 *33 

99,262 

' ■ "4lV6'05 ' 

FT/SEC 

ROLL RATE. 

11.200 

22*23*11 

-12.289 

22*23*27 

-0,147 

4.073 

OEG/SEC 

pitch rate 

7.569 

22*23*10 

" -2.794 

22 » 22*55 ' 

1,192 

1.766 

DEG/SEC 

YAW RATE...^.,. 

6.639 

22*23*25 

-11.550 

22*23*11 

-2,500 

4.172 

DEG/SEC 

alea rate,,,... 

4.879 

22*23*10 

-3.586 

22*22*55' - 

-0,003 

'1 .■543'” 

OEG/SEC 

BETA RATE^,,,., 

7,953 

22*23*11 

-6.476 

22*23*27 

•* 0 . 130 

2.474 

OEG/SEC 
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PILOT APPROACH PLATES AND WAYPOINT COORDINATE TABLES 
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0 

START 

0 

Ply outbound 

0 

Enter holding pattern 
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Exit holding 
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Slow to approach speed 
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Glide slope capture 


0 


Start go aroimd 


















■m- 1072-1 


C-i|- 



-BlOi-: 


AUGMEiraOE WHTG STI EEFEEEWCE FLIGHT PATH 2 (HIGH WOEKLOAD) 


WAY- 

POIHT 


LOCATION 


HEIGHT 
ABOVE 
AIEPOET 
Z (ftV 


FLIGHT 

PATH 

ANGLE 

(dee) 


THEN 

EADIUS 



STEADY STATE 

TTJEN CENTEE 

NOZZLE ANGLE 


X (ft) I Y (ft) ! MAX (deg) I MIN (deg 


1450 

12000 

18000 

18000 

12000 

6000 

6000 

0 

-9416 
- 1241 6 
-9416 
-6077 

-5039 

-1520 

940 


0 

0 

6000 

10000 

16000 

10000 

0 

-6000 
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-3000 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

-7.5 

-T-5 

-T • 5 

-T-5 

-T-5 

+T-5 


6000 12000 6000 


10000 

10000 


6000 12000 

6000 1 2000 

■6000 0 


•3000 -9416 -3000 

■3000 -9416 1 -3000 



Based on HASA Flight Path 5 by D, Watson for acceptance test of STOLMTO 
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AUGMBNTOR WING STI REFERENCE FLIGHT PATH 5 (HIGH WORKLOAD) 
Revised 27 February 197 ^ 


WAYPOHOT 


LOCATION 


X (ft) y (ft) 


HEIGHT 
ABOVE 
AIRPORT 
Z (ft) 



FLIGHT 

PATH 

ANGLE 

(deg) 


1 SUNOL 


6 MT. OSO 


3i|-715 

50906 

67096 

66950 

44720 

22489 


-209616 
-1861 46 
-162676 
-153386 
-123182 
-92977 


10 PATTERSON 


17 

18 G/A WPT 

• 19 - ^ 


23 STOmR 


20930 

20148 

19^90 

17931 

3509 

-2930 
-941 9 

_ 1241 9 

- 941 9 
-6077 

-3039 

-1520 

950 

1450 

12614 

15624 

11983 

-2535 

-3535 


-88426 

-58425 

-33466 

-28919 

-9353 

-6000 

-6000 

-3000 


19500 

21131 

18868 

19368 


Initial conditions at Waypoint 
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AUGMENTOR WING STI REFERENCE FLIGHT PATH 4 (MDDERATE WORKLOAD) 


WAYPOINT 

LOCATION 


X (ft) 

y (ft) 


HEIGHT 


AIRPORT 


FLIGHT 


TURK 

RADIUS 

(ft) 


MCE 

-53885 

r— 
21 4879 



r 

- 

1 

-39715 

103470 

2860 

120 



2 VOLTA 

-42628 

47786 

2860 

120 



5 STOMAR 

11985 

21131 

2860 

120 



NRC 

-2025 

-1000 

— 

120 



h 

-4798 

-6000 

i860 

120 



5 

-9419 

-6000 

i860 

85 


-3000 

6 

-12419 

-3000 

i860 

74 

-7.5 

-3000 

7 

-9419 

■ 0 

1 2ito 

74 

-7.5 


8 

-6077 

0 

800 

69 

-7.5 


9 

-3059 

0 

4oo 

69 

-7.5 


10 

-1520 

0 1 

200 

69 

-7.5 


11 

950 

0 

200 

120 



12 

1450 

1 

0 

200 

120 


-14630 

15 

1 541 8 

-12000 

2860 

120 

1 


14 

24534 

-53859 

2860 

120 


5500 

15 WESTLEY 

29166 

-58052 

2860 

120 

'j 

4193 

16 

, 

28289 

-49711 

2860 

120 



17 

15187 

^51088 

2860 

120 


4195 

18' 

16064 

-59429 

2860 

120 



SCK 

147980 1 

-45458 

136 


' ■ ■ ■! 
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APPENDIX D 


EDITED PILOT COMMENTS 


PILOT NUMBER 1 

Fljring cizrved Plight Plan 2 using the HSI and the EADI without the 
flight director and without the MPD seems unrealistic, because of 
the extremely hi^ workload with wind in purstdng curved courses . 

I use the coxirse predictor on the MFD to set the bank angle for 
curves when I don't have the flight director. [Editor’s note: 
flying curved paths using the IKI and EADI would be a realistic 
backup, if the flight director failed and the aircraft did not 
have an MFD; therefore, the MFD provides a more graceful degrada- 
tion to sitmtion information alone if the flight director fails, 
although it is a much more costly backup than the HSI.] 

O It's hard to keep track of where I'm going with the HSI. I need a 
waj^oint number display with the HSI, although the bearing pointer 
helps. I need to keep the DME comter in my scan frequently when 
using the HSI, because it re- initializes often when the waypoints 
are closely spaced. 

• Plight Plan 2 is possible with the flight director and the HSI 
but a lot easier with the flight director and the MPD, because a 
glance at the MPD tells me immediately where I am without having 
to correlate DME and bearing on the HSI with my memory of the 
waypoints passed over. 

• Throttle director bar and the speed error bug have the opposite 
sense in relation to throttle activity between frontside and 
backside operation. Let's change the sense of the speed error bug 
on the EADI to be fast, DOWN and slow, UP. This agrees with the 



sense of the IAS needle at 95 helps the throttle action to 

he consistent with the display on front and. backside operation. 
[Editor's note: this sense of the speed b\ig operation is opposite 

to that provided in some APIs for jet transport operation.] 


PILOT MMBER 3 

• When using the flight director I tend to fixate too imioh, sometimes, 
on the fli^t director and not enough on situation. In fact, I 
spiraled into a crash on Flight Plan 2 and just before waypoint 11 
even though I had the displacement window and flight director on 
the EADI and was using the MFD with the BSI covered. 

• I am gaining more confidence in the MFD with each fli^t. I'm now 
getting better used to the MFD and its course predictor than 
when I first encountered it. I didn't pay much attention at all 
to the MFD last week. 

O When using the HSI, an additional source of infoamiation must be 
available, i.e., a map or chart. 

• The HSI is very good but takes more concentration when flying on 
raw data. The green bearing pointer (No. 2) helps to anticipate 
turns to waypoints. 

• The high turbulence level (3 ft/sec EMS) causes excessive flight 
director activity. 

• I prefer to nse the MFD in its north-up orientation, because I can 
keep the direction of the prevailing winds more confidently in mind 
in relation to the flight plan. 


• The flight director makes the task so easy that I don't have to 
check the HSI as long as I have the EADI window. [Editor's note: 
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flying Flight Plan 1 with all three primary displays during 
training.] 

O While flying Flight Plan T with just the HSI supported hy the 
EADI I missed waypoint 5 the reference flight path mode 
disconnected. After that the HSI presented misleading guidance 
and I had to revert to the EMI to recover on final approach coiirse. 
While flying with the HSI alone and the EADI on Flight Plan 2 1 
lost waypoint 4 and turned south premattirely and ended up flying 
in a circle . 

• While using the MFD and the flight director without the HSI I ended 
up in a spiral crash just prior to waypoint 11 on the glide slope 
in Flight Plan 2. I think I developed tunnel vision on the flight 
director and forgot to monitor the situation until I was in trouble 

• I forgot to start the let-down at waypoint 8 in Flight Plan 3 when 
using the HSI alone with the EADI. 

• When I have both the HSI and the MFD available I like to check 
the MFD for arrival at waypoints and to anticipate course changes 
and altitude changes but I still use the HSI for tracking the 
straight courses and I use the course predictor on the MFD for 
setting the bank angle on curved courses. 

• When I was using the flight director with both the HSI and MFD, 

I checked the curved course predictor on the MFD and it was right 
on; it gives an impression of confidence. 

[The following comments by Pilot 5 are made regarding Flight Plan 4] 

• Easy to fly with either HSI or MFD; low workload. 

• Am getting more used to the MFD and glancing at it more, but the 
HSI is also very easy to fly because the green bearing pointer 
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moves automatically to indicate the direction of the next course 
segment prior to turns. 

• The flight director works satisfactorily. 

• Provided all of the enroute and approach plate information were 
available on call on the MPD, I could throw away my paper maps and 
get used to the MFD. 

• I wasn’t as precise without the flight director. 

• I prefer to use the north-up MFD to maintain proper orientation 
of wind with respect to course. I prefer the EMI over the pro- 
grammable heading display on the EADI for heading when using a 
north-up MFD- and the HSI is covered. I like the heading-up MFD 
only on final approach course. Since NEC EWY 55 is already 
practically north, I don’ t bother changing MFD to heading- up on 
final approach. 

• I like the flight director; when using the HSI alone without the 
flight director the workload feels much greater. 

• VHien using the MFD alone without the flight director, I didn’t 
have to use the STOIAKD mode select panel for the missed approach 
at all. I used the MFD in north- up orientation, used course 
predictor to set bank angle for missed approach, and used the 
course histoiy dots on the south-bound leg of the missed approach 
course to determine the distance off-set and the course for cor- 
recting wind drift. In this respect, the course history dots were 
very helpful in the missed approach when not using the reference 
flight path mode. 
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PILOT FUMBER It- 


• The heading- up map on the MFD is not helpful for initial acquisition. 
I prefer north-up map first, then I may switch to heading-up at a 
convenient point of low workload in the approach. 

• I used the HSI primarily for deviations and course changes hut 
checked the MPD for waypoints when I had both displays available . 

• When vising the BSI with flight director and situation in following 
Flight Plan 1 I almost forgot where I was at the waypoint 6. This 
is an extremely difficult task using the HSI. While slowing to 

approaching waypoint 6 I steepened my turn and almost lost 
the airplane. I was so busy I forgot to do the caution advisory 
task. 

• When using the MFD and the flight director and situation, I was 
confused by the throttle director again on backside operation. 

The pitch director called for nose-up because I was fast, and I 
couldn’t bring myself to bring the power back even though I was 

hi The map on the MFD gave me much more confidence about progress 
among waypoints than the HSI. I lost the airplane in roll while I 
was typing waypoint 1 [Editor’s note: this is typical of the 

problems encountered in a simulation with workload for pilot and 
copilot when only the pilot is available to do all of the tasks 
which the copilot should be doing.] 

• HSI - red number 1 bearing seems a distraction even though parked 
at north. One bearing pointer with multiple selections preferred. 

• I'or some reason, probably long-time use of HSI-type instrument, I 
felt more comfortable during the HSI run than with the MPD. I feel 
as thou^ I can acquire lateral and vertical displacement in .less 
time from HSI, although MFD seems to have more information available. 
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• With use of HSI, I have changed my mind about the quality of 
information available from the green bearing pointer. I find it 
very useful in BS I- alone maneuvers, 

• The presentation of vertical deviation on the HSI is analog and 
easier to assimilate than numerical altitude on the MFD. 

• I am seldom conscious of the digital heading on MFD. 

• In a tight tiorn (20-50 deg) the heading tape on the MFD moves so 
fast/ I have to get away from the tape until I roll out. The move- 
ment of the heading-up chart on the MFD is adequate until less 

than 15 deg bani;, then I can use the tape again. I like the compass 
on the HBI better but this may be due to my familiarity with the 
HSI. 

• The MFD chart seems demanding because I have to look in two places 
to confirm altitude and lateral/longitudinal displacement/ although 
I acknowledge that the MFD is much easier to keep track of progress 
among waypoints than the HSI. I don’t have to develop a mental 
picture with the MFD. 

• I’m not getting the quality of information from the window on 
the EADI that I am from the CDl/VDI on the HSI. 

PILOT NUMBER 5 

• When using the HSI with flight director and situation, I questioned 
whether the glide slope actually Started at waypoint 7 in Flight 
Plan 1 . There was no clear announcement of the start of glide slope 
[Editor’s note; this is a problem unique to the reference flight 
path mode of operation and has been noted by another pilot as well.] 
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• When using the MFD ■with flight director and situation^ I misread 
the altimeter on final approach and went around at 13 U 0 ft instead 
of 3ho ft. 

• It is -unrealistic to require precision tracking in holding patterns. 
The holding patterns should he deleted from, the MFD and just shown 
schematically on approach plates with arrows showing the direction 
of the txirn. If the missed- approach route is shown on the MFD it 
should he terminated at the holding fix- point. 

• HSI is preferable to the MFD for straight- course following, prohahly 
hecause of familiarity. The STOIAWD reference flight path mode 
coupled to the HSI, GDI, VDI, and DME gives everything a pilot 
needs to fly standard terminal arrival routes. The map on the MFD 
offers a -visual analog which helps to anticipate waypoints au/t turns 
hut DME is adeqmte on the HSI. 

• The EADI displacement window replaces the function of the GDI and 
VDI hut doesn' t have the familiar compass format . The map pro-vides 
the heading-up format when the HSI is missing hut doesn’t have as 
desirable a compass format as the HSI. There is no real advantage 
of the MFD in piece-wise straight- course following. 

• The MFD is far superior in turning maneuvers such as holding 
patterns, missed approaches, and curved approaches hut one should 
not depend on measuring tracking errors and excess control capacity; 
rather one should depend on the pilot rating, eye--point-of- regard, 

^ for comparing the MFD and HSI ih: these maneuvers. 

• I prefer to use the MFD heading- up. 

• Fli^t director makes control tolerable using the HSI alone, hecause 
it tells how much hank to command, and I just have to check the 

HSI for situation. 
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• The MFD course predictor also tells how much hank to command but 
it is not as relieving of workload as the fli^t director, 

• The BSI alone is possible to use with the EADI but extremely 
difficult to keep track of waypoints. HSI requires intense 
concentration, whereas a glance at the MFD provides immediate 
horizontal position orientation. 

• I don't like the clutter of the course and two bearing pointers 
when flying north. 

• The pitch flight director and the window on the EADI are very noisy. 

• The automatic flight mode is not a crucial test of differences 
between the BSI and MFD. 

• When using the HSI, EADI, and raw data in making the final approach 
on Flight Plan 2 1 thought I was still above the runway when I 
crashed on the glide path intercept point, because I was so busy 
correcting for the crosswind. 

• While using the excess control capacity measurement task with 
Flight Plan 2 I could not do the caution advisory task in turns 
because the workload was so high. 

[The following comments by Pilot 5 are made regarding Flight Plan 1 and MFD] 

• The course line is extremely useful on straight courses. Makes it 
very easy to stay on course in presence of crosswind. It is the 
most desirable feature on the MFD. 

• Heading information was hard to read and the digital heading was of 
no value . Poor heading information was my major complaint. 
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• The cotirse predictor was very usefixl for curved, path tracking. 

I did not use it on straight course as I tended to overcontrol; 
coxirse line was sufficient on straight path. I would prefer to 
remove course predictor on straight paths as it tends to clutter 
the display. 

• On the final approach there are two courses and I could not figure 
out what to track. Also seems cluttered at wa3^oints. I need a 
good clear picture of course and airplane to make intereept -- had 

f ■ ■ 

too much lettering in the vray. 

• The most help came from course line on straight path, course 
predictor on curved path, and flight path angle for altitude. 

[The following comments hy Pilot 5 are made regarding Plight Plan 1 and BSl] 

• I had no course line or course predictor which is a serious de- 
ficiency for curved path tracking and oh jectionahle for straight 
line tracking, due to very large crah angles required at low speed. 

• Green arrow covered up heading information. 

• Difficult to impossible to keep oriented on ESI during curved path 
tracking. 

• EMI heading scale has too many graduations , making it useless. 

[The following comments by Pilot 5 are made regarding Plight Plan 2 and 

MFD with fli^it (lLrector off 

• This is infinitely better than HSI without flight director, hovrever, 
this task is not acceptable for routine flight without at least a 
flight director. 

• Workload is very high, especially in turns - 100^. 
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[The following comments hy Pilot 5 made regarding Plight Plan 2 and HSI 
with flight director off] 

• I was semi- "lost” for most of the run; it was like following a 
white line in the fog. I thought I was still in a curved path 
when I hit the ground at the airport. I tracked the glide slope 
hut ]md no time to crosscheck altimeters. 

■ I 

• Workljoad was 100^ + . 

• This would classify as an extreme emergency in flight. 

[The following comments by Pilot ^ a.re made regarding Flight Plan 2 and MFD 
with flight director on] 

• l^D is a must for complex paths such as this one. I can tell 
orientation in a glance leaving adequate time to keep flight 
director bars centered and do side tasks. 

• I need more information to 

a) Warn of impending glide slope capture 

b) Advise pilot of safety margins 

• Flight director frequently gave erroneous cues during glide slope 
capture and tracking, e.g.j it said to fly up aud reduce power 
when already at 50 kt; this increases workload considerably. 

[The following comments by Pilot 5 are made regarding Flight Plan 2 and HSI 
with flight director on] 

• Curved path tracking without MFD is unacceptable because of problems 
with orientation in the turn. 

• The flight director was very busy and required constant attention 
to keep centered. 
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EDITED PILOT COMMENTS DURING SECOND PH/USE OF 
EXPERIMiNT EMPHASlZnra GEOGRAPHIC ORIENTATION 

PILOT, HUMBER 1 

• The HSI provides no look-ahead capahility and no direct display to 
ascertain correct hank angle in following or establishing curved 
courses like that on the MPD. It is difficult to keep up with 
progress on the approach plate when using the HSI, and there is 
insufficient raw data on the HSI to monitor progress of txirns in 
off-nominal situations when using the flight director. I find it 
hard to integrate DME, course deviation, and vertical deviation. 

The HSI is very seriously deficient in status information to provide 
for a confident capture of a reference flight path. [Editor's note: 
capturing a reference flight path with only the HSI and EADI was a 
traumatic es^perience for all — both pilots and investigators — 
who participated in this experiment; there is reason to believe 
that the STOLAND capture criteria were partly at fault in the cases 
of both VOR/TACAH radial courses and reference flight paths . ] 

• The MFD provides no vertical look-ahead capability without cross- 
checking the chart, there is no DME, and the vertical situation 
is not well presented. There is an awful lot on the MFD which is 
hard to read sometimes but not necessarily confusing. If correct 
map scale is selected, the clutter is not too bad, but I must 
remove certain items (e.g., runway) occasionally to eliminate 
clutter. For final approach I would like increased resolution 

on the MFD. I don't use the heading tape on the MFD very much — 

I prefer the heading vector in front of the airplane symbol. 

However, the MFD offers the advantage of uniform displacement 
sensitivity in a holding pattern, whereas the HSI' s angular course 
displacement sensitivity on VOR or TACAH at WESTIiEY (Flight Plan 4) 

^ : is lower. 


• Although I tried the course- select mode of the roll flight director 
on the north-hound leg and the heading-hold mode on the south-hound 
leg of the holding pattern at WESTLEY (Fli^t Plan I like using 
the raw data better than this flight director — it's too active. 

It's sufficient oi^st to use the pitch director for maintaining 
altitude. Another problem with this roll flight director in the 
course select mode occurs after I acquire the north-bound leg of 
the holding pattern at WESTLEY. Then the roll command develops 

a stand-off on the downwind side of the course, and when I null 
the director command, it develops a displacement stand-off on the 
same side of the course. [Editor's note: this stand-off problem 

was eventually eliminated by removing the signal from the director 
representing the integral of VOR or TACAN course deviationj this 
problem arose, because autopilot signals were in^roperly applied 
as flight director commands in the design of the STOLMD software.] 

• This fixed«base simulation of the airplane is marginally controll- 

able, and the attitude display is almost completely demanding of 
the attentional workload, because of the spiral divergence above 
100 kt and the oscillatory artifact in pitch. The airplane itself 
is easier to fly. [Editor's note: the oscillatory artifact in 

pitch is caused by an excessive cycle time in the EAI 8400 computer. 
Although several hours were devoted to try to correct the problem 
by modifying the pitch SAR, the restriction of airspeed to 120 kt 

or less proved to be the only partial remedy which worked.] 

PILOT ITUMBER 3 

• When using the HSI and chart, I might refer back and forth several 
times just to check my position with respect to one wasrpoint or 

fix point, whereas with the MFD, one glance is sufficient to confirm 
my position with respect to a segment of the flight plan or a fix 
point. 
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• I prefer a north-up MFD to help me maintain the proper orientation 
of the wind, with respect to the course. Then the only thing I have 
fco he careftil of is the direction of tvirning when headed toward 
southerly quadrants. I prefer the EMI over the numerical [pro- 
grammahle] heading display on the EA.DI when using the north-up MFD;, 
and the HSI is covered. I would like a heading-up MFD only on the 
final approach course. Since WRC Runway 55 is practically north, 

I don't bother changing the MFD to heading-up on final. 

• Flight director commands 25 or 50 deg bank angle at VOLTA. (Flight 
Plan 4, Waypoint 2) for course change. I prefer to use MFD course 
predictor to start the turn earlier and make a shallower turn with 

10 or 15 deg bank en route. Nevertheless, I like the flight director, 
especially in the terminal area and for the curved approach. When 
using the HSI and EADI without the flight director, subjective 
workload feels much greater . HSI requires more effort to remain 
oriented than the MFD and, in addition, the HSI requires constant 
reference to a chart. 

• MFD eliminates the mental gymnastics required when using the HSI, 

especially in entering and maintaining holding patterns, which are 
considered the most difficult problem in using an HSI. Although 
it's much easier to remain oriented with the MFD than the HSI, it 
still may be necessary to have a compass and bearing pointers as 
on the RMI. [Lditor’s note: Pilot 5 never used the heading scale 

on the MFD, because the scale does not appear with the north-up 
orientation of the map.] 

• VOE course displacement sensitivity seems lower than normal at 
1CESTLBY (Flight Plan 4) which is 20 nm fx’om SCK. [Editor's note: 

■ VOE/TAGAN course displacement sensitivity throughout ejjperiment 
was 5/6 of normal in order to provide 12 (instead of TO ) deg full 
scale displacement for off-course indication in the vicinity of 
NEG.} 
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• I woTOld like a vertical profile of my approach chart as well on 
the MFD, if I were to use it on final approach, but I don't need 
so many waypoints on final — just LOGO ft (altitude), glide slope 
capture point, 1000 ft (altitude), and minimum decision altitude. 
These should help to reduce the clutter on the final approach course 
on the MFD. Map scales of 5*0, 2.5> and 1.0 nm/inch might be more 
useful. I don't use the 0.5 nm/inch scale, except sometimes on 
final approach," but as long as I have the window box on the EADI, 

I don't really need to use 0.5 nm/inch on the MFD. It mi^t also 
reduce clutter on the MFD by presenting only the waypoints where 
the pilot has to change course, altitude, or speed and just the 
holding fix point, although more charts now shjw the holding 
pattern. Putting the course angles on the MFD along segments 
between waypoints might also reduce the clutter beside the way- 
points . 

• If the MFD in operational aircraft could be shared with the weather 
radar display at the forward end of the console between pilots, a 
moving map might be provided at no extra cost in panel space. HSI 
beeirings, IWE, and deviations would seem to be an essential backup, 
even for a moving map. I would think you'd want both HSI and MFD, 
if the MFD could be shared with the weather rad€u* display. In some 
ways the HSI is like a radar map of the ground — you know how 
cluttered that is? It's virtually useless, if you don't already 
kncr-t about where you are. Ground-mapping radar confirms your posi- 
tion, but you have to know where you are to use it. In a similar 
way the HSI improves my confidence in the moving map on the MFD. 

• When using the MFD alone without a flight director on the EADI, 

I didn't have to touch the STOLAND Mode Select Panel at all for 
the missed approach. I kept the MFD north-up, used course pre- 
dictor to set bank angles for missed approach course to fix point 
and for turns in the holding pattern, and used track history dotr 
on south-bound leg after left turn from. STOMAR (Flight Plan 3) to 
determine distance offset from V-109 and course for correcting 
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wind drift. The MFD should offer much better precision in holding 
than is possible with the HSI. 

PILOT KUMBKR k 

• When using HSI on Flight Plan 2, I seem to maintain a lower gain# 
because I’m not as impressed with my lateral deviations as on the 
MFD. I feel more eorafortable with HSI. When using MFD# I seem 
to fixate too long# and the roll axis gets away more. The green 
(waypoint) bearing pointer on HSI helps me to predict how to lead 
heading in turns to account for wind drift. On MFD I use course 
predictor for roll-in to turns and straight course line for roll- 
out of turns. 

• When using HSI on Plight Plan 5 without flight director# I have 
no feeling of precision. I had to spend so much time in course- 
keeping and configuration-changing during the approach that my 
altitude- keeping suffered. Then during final approach the vertical 
deviation indicator on the HSI required too much attention for 
adequate vertical control on glide slope. I even reversed my 
sense of vertical perception at one point in descent’. Throughout 
the initial approach in reference flight path mode on Plight Plan 5 
I need a simple numerical counter to keep track of the next waypoint 
number toward which the green bearing needle on the HSI is pointing 
when the MFD is covered. I think the counter would reestablish 
confidence about position when cross-checking between HSI and 
chart. Also throughout the same initial approach# the heading 

bug on the HSI seemed too active without perfoxming a 
useful role. [Editor’ s note: investigator responded. to request 

for waypoint counter with HSI by permitting all pilots to view 
the next waypoint number: presented on the MFD during the reference 
flight path mode. The map on the MFD was put: out Of view by using 
the slew switch whenever the MFD was not to be employed.] 




• When using both HSI and MFD on Flight Plan 3 without flight director, 

there is no comparison between HSI and MFD in terms of locating my 
position: the MFD is far superior, although the HSI gives good 

displacement sensitivity for tracking. 

• When using HSI on Flight Plan 3 with flight director, the STOLAHD 
slew switch caused inattention to roll and pitch attitude while 
selecting heading to intercept course to STOMAR fix point on V-IO9 
after go- around. Lost 9OO ft altitude in graveyard spiral, but 
recovered at Lit -0 ft. Used HDG SELECT flight director on south- 
bound leg of holding pattern, but its turns are too tight, i.e., 
it calls for too much bank, especially in upwind turn. I prefer 
to fly the entire holding pattern on raw data, because of the dis- 
traction caused by the STOLMD button-pushing and slewing orgy 
even when trying to use just heading-hold and course-hold flight 
director modes on the straight legs. 

• HSI VOR/MLS and WPT/TA.C selector knobs must be scanned to confirm 
function of HSI bearing pointers and DME. Failing to check these 
knobs in the terminal area can get you into trouble. If knob 
positions were more clearly identifiable, they might attract my 
attention better during a scan. It would also be preferable to 
have the heading and course selection knobs on the HSI. 

• Can't remember referring to glide slope needle during one final 
approach on Plight Plan 3 , so assvime an inappropriate dependence 
on the throttle and pitch flight directors'. 

• When using HSI on Plight Plan if, I was so overloaded that a copilot 

was necessary for tuaing radios and entering keyboard data. I 
seemed to accept lower precision than earlier HSI runs as best 
attainable . ; ■ V 

• When using MFD on Plight Plan 3 without flight director, I think 
MFD is far superior to HSI, because MFD allows more time for 
vertical task. In holding patterns the MFD is a great help, 
because upwind turn must be quite shallow in high wind to protect 
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downwind turn for radial capture to return to fix point. Other- 
wise you reach the hank limit of the aircraft in the downwind 
turn. However, I would like to see. a trend vector (i.e., course 
predictor) with more sections of shorter length each for better 
intercept data. Also, the trend vector is too sensitive on the 
0.5 nm/inch scale; would prefer a shorter course predictor to 
reduce its activity. I usually orient lyiFD heading- up for approach, 
north-up for go-around, and heading- up for holding pattern. 

• Flight director allows overshoot on turn to final approach with 
20 kt tail wind on base leg and 7^ ht true air speed. Workload 
can be reduced in use of flight director by turning to desired 
heading or course using raw data (especially MFD) and then engaging 
appropriate holding mode of flight director . Turns can be shallower 
and better controlled, and you don’t have to struggle with slew 
switches as much. 

• When using MFD on longer straight courses in Flight Plan 1. in 
heading-up orientation, the course vector, trend vector, and map 
course line all merge and leave a sense of losing course information 
for short periods of time. J/IFD heading scale doesn’t have a clear 
bold lubber line — - very hard to use. 

• EA.DI "window box” presents difficulties, because I find it unnatural 
to relate displacements in space to the nose of the aircraft symbol. 
Instead, I prefer to relate displacements in space to case- fixed 
points on the frame of the display which I associate with the center 
of gravity of the airplane behind me. There is too much confusing 
pitch activity by the horizon and pitch scale which distracts from 
(i.e., clutters) interpretation of the window, The horizon does 
not interfere with the interpretation of case-fixed displacement 
indicators on a conventional attitude director indicator. 
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PILOT NUMBER 6 


• When HSI limits its deviation, you don’t know how far off course 
you are. MFD overcomes this limitation of HSI. On "downwind" 
and base legs and final approach, the waypoints are so close that 
DME resets itself too frequently and offers few clues to progress 
among waypoints. The reference flight path mode doesn’t give a 
significant glide slope captvire cue. The HSI presents inadequate 
navigation status information on downwind leg and in final turn. 

The available number of choices (e.g., WPT/TAC and VOR/MLS) in 
the use of bearing and distance on the HSI leads to a sense of 
clutter and additional thought while searching the panel for addi- 
tional information. The display attentional workload is completely 
demanding between the HSI and approach chart due to the uncertainty 
of position status on downwind leg, final turn, and descent. HSI 
is less demanding in other flight phases. Precision with HSI is 
inadequate in terminal area approach task, but satisfactory in 
holding pattern. Yet precision with HSI may actually be better 
than with MFD, because you must track HSI very closely in order 

to maintain understandable horizontal situation. 

• The flight director is significantly better only in final turn and 
descent where it reduces workload and improves precision somewhat . 
However, the final turn is still not too easy to control. Must 
work hard to discern progress in position around the turn by check- 
ing heading against course. I turned off the roll flight director 
during go- around to intercept course to STOMAE in Flight Plan 3 
for holding fix. After indirect entry to holding pattern, I used 
roll director to track north-bound course to STOMAR, then turned 
left without using director and resumed heading-hold director on 
south- oound course. 

• Even with the MFD the base leg turn to final approach with the 
20 kt tail wind on the base leg is still the most demanding part 
of the task — more so than the holding pattern, which is normally 


hard to estahlish iti a crosswind, hut which is greatly aided hy 
the MFD. However, the heading-up MFD is disorienting in turns 
at low speeds, because of the relatively high turn rates. I*ve 
noticed the same effect in the airplane when the MFD map swings 
around the airplane symbol. I might prefer north-up MFD, except 
on final approach. I also had problems with scaling and resblu- 
tion on the 1.5 nm/inch scale — 0.5 nm/inch might have been better. 
Both MFD and EADI seemed quite cluttered — I had to use the EADI 
more than when the HSI was available. 

• EADI is cluttered with both "window box" and flight director in 
use. However, in the base leg turn to final approach course on 
Fli^t Plan 3 wi"fch flight director commands displayed, I e^qjerience 
less of a problem trying to use the window box as a director, and HQT 
precision is better. 

• Vertical situation information is insufficient for descent and 
deceleration with MFD and EADI. Although lateral precision in 
final turn is better with flight director, glide slope acquisition 
cues are still deficient. Precision on straight final approach is 
better with flight director in both lateral and vertical tracking. 

• Even at high sensitivity, the MFD does not induce good tracking 
around final turn without a flight director — of course, neither 
does the HSI. Suggest that stronger associated heading information 
as on HSI might help the MFD, which has a poor heading scale. 

• Clutter on the MFD is especially noticeable during final turn and 
final approach — - too many waypoint numbers — hard to find air- 
craft symbol. Dislike heading- up MFD at high sensitivity in high 
rate turns . Sometimes I have to reposition map north-up. 

• The heading reference required to hold the desired course is much 
' easier to pick off the HSI rather than the MFD heading scale. 

• When using the MFD, I prefer to disregard the roll flight director 
in the holding pattern . Even with the pitch director to help main- 
tain altitude in the holding pattern, I use inertial flight path 
angle as well. 
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• Sensitivity of HSI course displacement in holding patterns is too 
low. HSI compass motion is also disorienting in turns. The HSI 
is definitely a rectilinear flight instrument. 

• When using hoth HSI and MPD on Fli^t Plan 4 without a flight 
director, I use HSI for en route tracking hut check MPD for progress 
On the base leg turn to final approach the turning course needle 

on the HSI is disorienting. Although the 20 kt headwind on the 
base leg helped to slow the turn and to give me more time to 
capture the glide slope, I paid too much attention to the window 
box on the EADI rather than the MPD on the 0.5 nm/inch scale. If 
the VOR/MLS and WPT/TAC knobs on the HSI aren't set properly, the 
DME and bearings on the HSI will lead you astray. I used the MPD 
to set up the holding pattern, especially in the turns and the 
south-bound leg, but I used the HSI for tracking the north-bound 
course to the fix point at WESTLEI. 

• The flight director makes me work too hard on the first straight 
leg from vmypoint 1 to 2 in Plight Plan the roll director has 
too much quickening for me. 

• When using the MFD and EADl without the flight director on Plight 
Plan k, capture of reference flight path at Waypoint 3 is easier 
than with the HSI. I don't have to guess so much where I am. 

The clutter on the MFD is significant when crossing over the NEC 
TACAN and when on final approach course. 

COLLECTED RECOMMENDATIONS FOR STOLAHD DISPLAY 
MODIFICATIONS BASED ON PILOT COIMJTS 

The EADI "window box" presented difficulties for two of the pilots, 
apparently because of its central location. One perceived it as a 
flight director and had to suppress this impression repeatedly. The 
other perceived it beyond the "nose" of the airplane symbol and 
experienced confusion between displacement and pitch angle cues. A 
recommendation would be to compare the "window box" with the "pole 
track" or "channel" displacement symbol in another experiment. 
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There is a project called "pole track MPD" in the STOLAUD 
simulator files . ) Pilot 1|- expressed a preference for presenting 
displacement information at the bottom and right margins of the 
EADI, because he is accustomed to associating the marginal loca- 
tions with the spatial position of his own aircraft, whereas he 
associates the central location with the pitch of his aircraft. 

Slewing switch operation proved clumsy. Overshoots in turns occurred 
while trying to select a new course and there were instances of loss 
of both attitude and altitude awareness while trying to operate a 
slewing switch. Only the two pilots most familiar with the keyboard 
mnemonics chose to use keyboard entry instead of sle>ri.ng switches. A 
recoinmendation would be to put the course and heading select controls 
back on the HSI as displacement controls rather than rate controls. 

The VOR/MLS and WPT/TAC selector switches might remain as knobs or 
rings concentric with the course and heading selection controls on 
the HSIj however, annunciation for the VOR/MLS and WPT/TAC switches 
must be much clearer than at present. The positions of these two 
function selectors were not sufficiently apparent to several of the 
pilots, even though they knew they should be scanning the switches 
when functions were being changed. At least a green label for WPT/ 

TAG and a red label for VOR/MLS would be a help, but a more startlingly 
apparent display of each selected switch position is apparently needed. 

It should not be necessary both to select radio navigational stations 
for STOLAND and to select radio frequencies for the receivers . One 
set of selections should suffice. A recommendation would be to arrange 
for STOLAND to read whatever frequencies are selected for the receivers 
and to display the appropriate station identities on the MPD after 
using an internal table look-up routine. 

The space on the MPD which is presently devoted to the heading scale 
would better be devoted to presenting a vertical approach profile. 

Shorten the length of the curved course predictor on the MPD when the 
0.5 nm/inch scale is selected so as to reduce its apparent sensitivity. 


lor- code the DME windows on the HSI red and green to improve the 
arity of their association with the bearing pointers and function 
lectors . 
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BYE-P03UT-0P-BEGAIU) DATA REDUCTION 

A digital computer program has been written to reduce the EPR data to 
scanning statistics. The output consists of dwell time statistics and 
histograms for each instrument, summations for all instruments, and one 
way link transitions between instruments. This program could easily be 
changed to include more positions in the visual field, but for illustra- 
tion this section describes the results in terms of pilot scanning behavior 
for an eight position display field. The ninth position is for blinks. 

Some definitions of the properties of the raw and reduced EPR data 
are needed. For a given run of Tj^ sec duration: 

M is the number of instruments 

is the number of fixations on instrument i 

Nj 4 is the total number of fixations on all instruments 

N is the total number of fixations on instruments, 

elsewhere, blinks, etc. 

It follows that 

M 

% = E % 

i =1 
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Average properties of the data are important. The mean dv;ell 
time on instnument i is 


k=l 


The "scan rate" over all instruments on the panel is the average numher 
of fixations per second, given by 


f ^ ^ 
® Tr 


The scan rate on a given instriuaent is called the "look rate," given by 




^Si 




The fraction of fixations on the ith instrument, is cal 3 .ed the 
"look fraction, " 


''i “ N 


The "dwell fraction" is the fraction of time spent on instrument i, given 
by 

Ti . 

This is also called the "fractional scanning workload. " The "look interval" 
is the inverse of the look rate, i.e.. 


'Si 


1 

fsi 


The look interval is a measiire of the recycle time, and it can also be 
computed from the individual scan intei-vals (the time betvreen successive 
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looks at an instrument). The following quantities were printed for each 
instrument: 

SBIBOL 


• Maximum and minimum dwell times 

« Total dwell time, T^_ 

I ' I 

• Huniber of fixations, % 

• : ^ i- 

• Mean dwell time, Td^ 

• Dwell time standard deviation, 

• Dwell fraction, Tij_ 

O Look fraction, 

• Look rate, fg^ 

• Dwell time histogram at 0.25 sec intervals 

• Look interval, 1 /fg^ 

The data for all instruments included: 

• Total dwell time, ]^Ti 

•! Total number of fixations, Nm 

• 'Scan rate, fg 

• One way transition links 


TMX, TMN 
TD 
W(I) 

TB 

SD 

DF 

LF 

LK 


LI 

N 

SR 


Summaries of definitions for the symbols used in the typed tables of 
EPR statistics are presented in Tables E- 1 and E-2. Table E-3 then presents 
the run identification for the reduced EFR data which follows in TablesE-4 
through E- 1 1 in this appendix and Figs. and 25 in the text. The histogram 
and link matrix portions of the output require some additional mention as to 
their interpretation. Primary link values are listed in Tables E-k through 
E-7, and the con^jlete transition link matrices follow in Tables E-8 through 
E-11' .,: : 


The ordinate of the histogram (Figs. 2k and 25 in the text) has 0.000 
representing the dwell times from 0.000 to 0.2^9 sec, 0.250 representing 
0.250 and 0.499 sec, and so on. The numbers to the right of the dwell time 
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intervals are the number of occurrences falling within this interval. The 
abscissa represents this number as a percent of the total dwells. 

The transition links are read as the looks FROM instrument I (on the 
left side of the matrices in Tables E-8 through E-1 1 ) TO instrument J (along 
the top of the matrices) (l / J). This number is expressed as a percent of 
the total number of transitions. The total may not add to 1.000 because 
only primary link values are listed in Tables E-4 through E-7 and because 
of roundoff in the complete matrices. 

The complete scan transition link matrices in Tables E-8 through E-11 
show occasional evidence of slight asymmetry among the one-way link values 
for the primary displays as well as the conventional instruments. Different 
one-way link values between the same pair of instruments are indicative of 
circulatory determinism in scan patterns. Transition links appearing between 
instrument 5 (MFD) and 5 (HSI) are indicative of direct cross-checking between 
the primary horizontal di(?plays. Such links, although rare, are predominantly 
unidirectional from HSI to i*3FD by Pilots 1, 3 , and 4 when using raw situation 
data.: 


TABLE E-1. SYMBOLS FOR EPR STATISTICS 


SYMBOL 

P 

R 

C 

WP 

TR 

K 

SR 


DEFDIITIOR 

Pilot X 
Run Y 
Case Z 

Waypoint Interval A to B and Date 
Total run time, sec 

Total number of dwells 

— 1 

Scan rate = N/TR, sec 


I Instruiaent number: 

1=1 = IVBI 
2 = EADI 
5 = MFD 

4 = Barometric Altimeter 

5 = HSI 

6 = IAS 

7 = To the right of the primary instru- 

ment panel (i.e*, function switches 

and engine instruments) 

0 = Above the primary 
instrument panel 
(i.e., the flight plan) 

9 = Blinks (not counted) 


N(I) 

Number of fixations, Ni 

TD 

Total dwell time, Ti 

TMX, TMW 

Maximum and minimum dwell times 

TB 

7 Mean dwell t ime, f < 3 ^^ 

SD 

Standard deviation of dwell time, 

DF 

Dwell fraction, ti 3 _ 

LF 

Look fraction, vi ^ 

LR 

Look rate, fs-^ 

ll;; 

Look interval, 1 /?si 
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TABLE E-2. DEFINITION OF WAYPOINT GROUPINGS 




CASE 

NO. FLIGHT PLAN 

C2— 2 


(WP) 

WAYPOINTS 


DEFINITION 


C2— 

G3- 


2 

5 


C5- 


k 

8 

9 

12 

8 

12 

15 

18 

21 

22 

25 


6 

9 

11 

11^ 

9 

15 

18 

21 

22 

25 

29 


Turn at constant altitude. 
Straight, decelerating fUght. 
Decelerating turn. 

Final approach. 

Straight, descending leg. 
Decelerating tiirn to final approach. 
Final approach. 

Go-ai‘ound leg. Climbing, acceler- 
ating flight. 

Turn to holding pattern. 

Enter holding pattern. 

Holding pattern . 


TABLE E-5 

RUN IDENTIFICATION FOR THE REDUCED EYE- POINT- OF REGARD DATA 


RUN 

NO. 

PILOT 

FLIGHT 

PLAN 

LEVEL OF 

DISPLAY 

CASE 
NO. , 

TABLE 

NO. 

Rll»-8 

3 

3 

Situation (raw data)^ ^ ^ 

C301 

D-8a 

li<-9 

3 

3 

Fli^t director 

and situation 

302: 

p-8b 

15^ 

1 

3 

Situation 


301 

D-7a 

155 

1 

3 

Flight director 

and situation 

502 

D-7b 

15^ 

1 

■ . 2 : 

Situation 


; 201 

D-6a 

157 

1 


Flight director 

and situation 

202 

D-6b 

26l 

V ■ 


Situation 


201 

D-5a 

257 


7-P 2 7 

Flight director 

and situation 

202 

D-5b: 
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TABLE E-4. EPR STATISTICS 







a. 

Run 261 









X 

M<I> 

Tli 

TMK 

TMM 

TE 

SB 

BF 

LF 


LI 

TRRHSITinh 

LINKS 




SEC 

SEC 

SEC 

SEC 

SEC 



SEC 

SEC 




P4 R261 C201 

1 

0 

1 .3 

0.7 

o'^s 

o7? 

0 . r 

.01 

.02 

’.02 

50.5 

2— >3 


.200 

WP 4-S 20M8R 

0 

46 

35 Q 

2.1 

0.4 

0.8 

0.4 

.36 

.41 

,46 

8.2 

3~>2 


.300 



ObZ 

42.4 

2.9 

0.5 

1.2 

0 ,5 

.42 

• 32 

.3 6* 

2 .8 

2— >5 

^ - ' 

.036 

TR-101 .0 2PC 

4 

1 

0.4 

0 .4 

0.4 

0.4 

0.0 

.00 

.01 

.01 

101.0 

5“>2 


.018 

ri - 111 

CJ 

4 

3.2 

1.2 

0.4 

0,8 

0.3 

.03 

. 04 

.04 

25,3 

2“ >4 

— 

. 000 

SR^ 1,10 l.'S;EC 

■'6' 

18 

13.6 

1 .0 

0.4 

0 .3 

0/2 

. 13 

.16 

.18 

5 ' A 

4-“>2 


.000 


1* 

4 

4.2 

1.7 

0.7 

1.1 

0.4 

. 04 

.04 

.04 

25 .3 

2— >? 

- 

. 009 


8 

0 










7— >2 

"= 

.009 


9 

0 














I 

MCI) 

TB 

TMX 

TMN 

TE 

SB 

DF 

LF 


LI 

TRaHsiTinn 

1 I w^S 




SEC 

cjrr 

3 EC 

:">^r 




SEC 

SEC 
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1 


K9 

1 .0 

0.9 

0.9 

0 . 1 

.04 

. 03 

> 04 

25\4 

2-’- >3 


.169 

WP S-9 20MPP 

2 

'“iT* 
w 1 

2 2 * S' 

2.6 

0 . 4 

0.8 

0 .5 

.45 

.45 

,53 

1 .9 

3— >2 

•s 

.186 


Pi 

13 

9.9 

1 .1 

0.4 

0.8 

0.2 

.20 

■ 22 

. 26 

3.9 

£“>5 


.051 

TR^ 50.? 2EC 

4 

0 










5~>2 


.034 

N " 60 

cr 

0 

3 2 

1 .4 

0.5 

1.1 

0.5 

.06 

.05 

,06 

16.9 

2— >4 


.000 

SR^ I.IS 1/SEC 


13 

llU 

1 .3 

0 . 4 

0.9 

0.3 

• 22 

' .22 

.26 

3.9 

4 — 72 

^ . 

.000 



0 

1.5 

0 .9 

0 - 6 

0.8 

0.2 

.03 

. 03 

.04 

25.4^ 

2~>7 

•z: 

.017 


0 

0 










7“>2 

■= 

.017 


9 

0 














I 


TB 

TMK 

iriM 

TE 

SB 

BF 

LF 

LR-i 

LI 

TRRMSITIDM 

LINKS 





•rcf* 

■^.EC 

•r CT i**: 

Cl”; 



SEC 

SEC 
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1 

15 

8.9 

I7o 

0 .4 

0.6 

0.2 

.11 

.16 

.19 

st-i 

2— “*>3 



UIP 9-U 2CMBP 

■' 0 ■■ 

42 

39.7 

3.1 

0.4 

0.9 

0 .5 

.49 

.45 

CJC 

1,9 

3— >2 

■ ” ' 

£58 


w 

•r*e? 

19.5 

1.0 

0.5 

0.8 

0.1 

.24 

.2? 

.31 

•T» 0 

2— >5 

- , 

,011 

TR*=^ SO. 6 ^EG 

4 

0 










5— >2. 

- 

.000 

H ~ 94 

5 

1 

0.7 

0.7 

0.7 

0 .7 

0 . 0 

.01 

.01 

.01 

90,6 

2— >4 

-= 

,000 

SR^ 1.1? l.'SEC 

6 

6 

5.4 

1 .3 

0.5 

0.9 

0.3 

.07 

.06 

.07 

13.4 

4— >2 


.000 


r* 

5 

6.5 

z* 

0 ^ *z 

0 .7 

1.3 

1.0 

.08 

.05 

.06 

16,1 

2-->7 

'ts- 

. 032 


8 

0 










7— >2 


,022 


9 

0 














I 

HU> 

TD 

iriK 

TMM 

TE 

SB 

BF 

LF 

LR., 

LI 

TRRHSITIOH 

.LINKS 




SEC 

SEC 

SEC 

SEC 

SEC 



SEC 

SEC 
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1 

C; 

7.1 

1,4 

0.4 

0.9 

0.3 

.12 

.16 

. 13 : 

7.5 

L'.' '2— >3^^ 

J= 

.122 

WP 12-14 20MPP 

2 

24 

3^' . 3 

5.2 

0.4 

1.5 

1.2 

.61 

.48 

.40 

2.5 

3“>2 

■= 

. 163 


P 

3 

9.4 

1 . ( 

0.7 

1 .0 

0 .3 

.14 

.16 

.13 

7.5 



V P ^ ^ CL 

TR- 60.0 SEC 

4 

0 










5-->£ 


.122 

H - 50 

5 

to 

4.9 

1.0 

0.5 

0 . 3 ' 

0.2 

.08 

.12 

.10 

10.0 

2“>4 


.000 

SR= 0.S3 l.-^SEC 

6 


1 .3 

0.6 

0.6 

0.6 

0 . 0 

. 02 

.04 

.03 
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TABLE E- 5 . EPR STATISTICS 
a. Run 156 



I 


Til 

TMX 




SEC 

SEC 

PI R15j£. C201 

1 

0 



mp 4“£. Sf-tpp 

E 

51 

66.0 

10.6 


c* 

31 

IS. 7 

1 .6 

TR- 100.7 cEC 

4 

34 

16 . 0 

O.S 

H ^ 106 

C- 

0 



1 .05 1 .-GEC 

sl« 

0 




7 

0 




y 

0 




9 

0 




I 

IKI) 

TD 





SEC 

SEC 

PI R1S6 CEOl 

1 

0 


yp 0—9 

E 

36 


4 ,4 



13 

10.5 

1 .5 

TR^ 50.4 SEC 

4 

•-» 

1.3 

0.6 

M = 55 

c* 

0 



SR= K05 lv-C£C 

6 

1 1 

. 4.9 

0.6 


■jT* 

0 




P 

0 




9 

0 




I 

Has* 

TIJ 





SEC 

S' E C 

PI R156 CEOl 

1 

0 



!iJP 9-il 5HPP 

E 

33 

59.4 

^ 1 ' . 6 ' 


3 

19 

15.4 

1 . S 

TR^ 79. -4 SEC 

4 

0 



H = 45 

Cj 

S.'- ' 

1.3 

0.6 

SR= 0.57 l-'SEC 

6 

0 




Y* 

3 

3.5 

3 .4 


i3 

0 




9 

0 




I 

MCI> 

TU 

TMK 




SEC 

SEC 

PI R156 CSOl 

1 

0 



WP lE~i‘4 3MPP 

w 

31 

46 . S 

6.9 


S‘ 

3 

1.7 

: T. 0 

TR“ 60.5 SEG 

4 

0 



H •= : 41 

5 

IS 

13.0 

1 .5 

SR- 0.63 1/SEG 

c 

0 





0 





0 




9 

0 




Ttlfl 

IB 

SD 

HP 

LP 


LI 

TRANSIT IGH LINKS 

C^'C 

Sec 

SEC 



SEC 

ccr 

0 

>3 

“ .163 

0 .3 

1.3 

1.4 

. 66 

.46 

.51 

3.0 

3— 

>3 

= .190 

0.4 

0.9 

0.3 

.19 

.30 

.31 

4 vB 

3— 

>5 

= .000 

0 • ,<J 

0.5 

0 . 1 

.16 

.33 

.34 

3 . 0 

5--- 

■>3 

= .000 








^ 0 

>4 

= .334 








4— 

•>3 

= .336 








O— — 

>7 

= .000 








7— 

>3 

- . 000 

TMN 

TE 

SIi 

BP 

LF 

LP 

LI 

TRRNS 

ITIDf'i LINKS* 

SEC 

SEC 

SEC 



SEC* 

SEC 

O — ^ 

>3 

= .313 

0^3 

1.3 

1.3 

• iV 

-49 

.53 

1 .9 

3~ 

>3 

“ .350 

0.4 

O.S 

0 . 3 

.31 

.35 

.36 

3 . 9 

i-' 

>5 

= .000 

0.3 

0,4 

0.3 

.03 

.06 

.06 

16.S 

5“- 

>3 

= .000 








3— 

>4 

= ,050 

0.3 

0.4 

0.1 

• 10 

.31 

C'O 

4.6 

4— 

^3 

— • 053 








3“-- 

>7 

. 000 








7— 

>3 

= .000 

TMH 

TB 

SB 

BP 

LP 

Lf? 

LX 

TRBNS 
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SEC 

SEC 

SEC 



SEC 

SEC 

O— 

>3 

= .4 09 

0 .4 

‘I* /T* 

3.0 

.75 

.49 

■ 3S 

3 . 6 

3" 

>3 

= .4 09 

0.4 

O.S 

0.3 

.19 

.43 

.34 

4 ,3 

O — — . 

''•S 

= .033 
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= .045 
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~>3 

= .050 
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table E -5 (ConGluded) 
L. Run 157 


FI Si 5? Cr;0£ 

WP 4-^^^ 3f’lPiP 

TR"100.1 SEC 
H ~ as 
SR= 0.55 1 ^‘SE 


TH 

SEC 

TMK 

SEC 

TNM 

SEC 

TB 

SEC 

SB 

SEC 

DP 

31 -4 

13.3 

0.4 

4.5 

4.0 

.31 

1 0.0 

2 .7 

0.4 

1 . 0 


.10 


C.S 0 .? 


0,5 0.5 0.0 .00 .03 


£.0 0.3 


,01 1 00.1 


1.4 0.4 . 03 A T . 0 3 1 3 . 7 


TRfiMSlTION LINKS 


£~>3 = 
3 ">£ = 
£~>5 = 
5 — '>2 = 
,£“>4 = 
4— >£ = 
' £— >7 = 
7— >2 = 


I N<I> Til 


PI R15? C202 
!,JP S-9 3MFR 

TS= 50.3 SEC 
!i= 12 ■ 

SS.= O .SS l/CEC 


TMK TMN TB 3D DP 

SEC SEC SEC SEC 


10 -44.7 1£.5 1.2 4.5 

F, 3 .2 0 .E 0 .4 0 .5 


0,2 O.E 


O.l .OS 


:.£0 5.0 

.12 S.4 


O.S 0.1 ,05 ,16 .06 IS.S 


TRPlHSITlDM LIHKS 

2— >3 = .333 
3“>2 = .333 
£-^>5 = .000 
5— >2 = .000 
£—>4 = ,000 
4 — > 2 = .000 
2— >7 = .167 
7— >2 = .167 


Fi R157 C202 
WF 2-1 1 3MFR 

TR= 72.3 SEC 

H - 21 

SR= 0.26 1. ■■■SEC 


PI R157 C201 1 

UIP 12-14 3MFiR 2 

3 

TR= 63. 1 SEC 4 

N = 15 • -5 

SR= 0.24 l/SEC' 6 


TD 

SEfl 

TMX 

SEC- 

TMN 

SEC 

TB 

SEC 

SD 

;-;CQ 

DF 

LF 

CR_, LI 

r.*cr 

TRFUSSITIQN 
2 ^>3 = , 

71 .2 

14.3 

0-7 ; 

0.5 
0 .4 

3.5 

4.9 

o.l 

.90 

.03 

.52 

.19 

.14 7.2 

.05 19.3 

3 — >£ = 
2— >5 — 
5“““>3 = 

2.4 

0 a >' 

0.5 

0 .3 

0.1 

.03 

. 19 

.05 19.3 

£— >4 -- 

4 — >£ =: 

3.4 

2.3 

0.9 

1 .7 

4 

1 .•=. 

.04 

.10 

,03 39.7 

£— >7 
7“>£ = 

TD 

SEC 

TMK 

SEC 

TMN 

SEC 

TE 

SEC 

SD 

SEC 

LF 

LF 

LR^i LI 
SEC. SEC 

trrhsition 
£— >3 = 

55.4 

2.7 

17.5 

1.1 

0.3 

0.3 

3.9 

0.9 

3.2 

0.2 

.S3 

.04 

.53 

,20 

'.13''--7v2 ■' 

.05 21.0 

3- -'>£ == 
£-->5 - 
5— >£ 
£— >4 = 

4— >£ = 

5.1 

2.4 

0.7 

1.3 

0.3 

.03 

.27 

.06 15. S 

£-->7 = 
7-->£ = 


LIUKS 
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TABLE E-6. EPR STATISTICS 
a. Run 15^ 

D TMH TD .V LK 


PI m ‘:*4 C 301 

ijjp 

rr - Ho.-i lEic 

fi ^ -“.Iv 

o.ru i z:v: 


Ft C3C1 

WP 1^~15 3MPP 

TP^tOUi CEC 

M ^ *10 

0 . 4 C I'^StC 


PI Rl^?4 CcOl 

WP 15- IS 3MPP 

TR ^ 50.1 3 EC 

H - ^5 

3:p= 0.50 l-'SE 


PI P154 C301 
WP 1S-£:1 3MPP 

TP^ 60.3 SEC 
H *= 40 

CR - 0.66 l^SEC 


PI R!54 C301 
WP 2t~22 3MBR 

Tp-^ 0.6 SEC 

^ ^ M 61 /: 

SE~ 0.76 jvSEC 


PI P154 CSOt 
yp 32-3:5 *3MBR 

TR^ 60-7 SEC 

H S= 70 

SR^ t .15 l/'SEC 


PI PI 54 CCOl 
flip 35-29 3MBP 

TR-140.4 sec 
H - 1 64 

SR- 1.17 I SEC 


7 I 0.9 

9 1 0.7 

9 0 

I »Kl> TH 


2 19 91 .S 

3 12 12,4 

4 0 

5 ' S 6.0 

6 0 

7 I 1.2; 

9’ 0 

9 ■ 0 

I H<I> TD 

•>cr 


1 l.S 

0 


I run TD 


IS 37.4 
S 9.4 


l!iP T 5 H 
j-EC SEC 

3.3 0,4 

1 .S O.r. 


0.9 0.9 

0.7 0.7 


tmj : tmm 

*‘EC SEC 

13.7 0,4 

2.0 0.5 

l.C 0,5 

1 ,2 1 .2 


tr^H TMH 
SEC SEC 

7.6 0.3 

2 , S' u.*-' 

1.1 0.5 

l.S l.S 


TMK irlH 
SEC SEC 

7.6 0.4 

2.5 0,7 

1.4 0,4 

2.3 0.6 


r.P LP LR ., LI 


IRflHSITlDM LIhKS 

£ ^'^3 s: .’016 


1 NCI> TO 

^CQ 

1 0 

2 37 33 , 3 : 

3 19 19.5 

4 0 

5 7 7.0 

6 1 0.5 

7 4 S.S 

S 3 5,3 

9 0 

1 !KI> TB 

SPr 


1 .9 1 . 0 

1 .1 0 . 4 

1,1 0.5 

0 . 9 0 . 0 

0.7 O-O. 


TB SIi 

:ec sec 

4.3 3.4 

1.0 0.5 

0.7 0.2 

1.2 0.0 

TB SB 
■/•cr. SEC 

3.0 2.4 

1.3 0.6 

0.S 0.2 

1.3 0.0 


TB SB 
SEC SEC 

2.1 1>9 

1.2 0.7 

O.S 0,3 

1.4 0.9 


33 31.9 

14 12-6 

10 5,2 


1 I > TB 

‘ SEC 

1 0 


10 4.; 

35 17.2 


TMX TflH 
SEC SEC 

6.1 Ov 4 

2.6 0.5 

1.5 0.5 

0 .5 0 .5 

3.9 0.7 

2.2 1.5 


jm TMM 
SEC SEC 

2.3 0.3 

1.5 0.6 

0.7 0.4 

0 .6 0.6 

1.0 0 .3 

2.0 O.S 


tm:; im 

SEC SEC 

2,9 i',3 

1.3 0.5 

0.5 0.4 

O.S 0,4 

1.0 0.3 

2.U 1,0 


TB SB 
SEC SEC 


. 1 

.46 

.3^' 

3.1 

3-->2 - .097 


,U7. 

. 1 0 

.07 

15.1 

£-.->5 = .419 
5— >2 = .££3 ^ 


,30 

.41 

.^9 

3 .5 

2— >4 = .000 

I . 





4 — >£ - .000 

k 

.01 

. 02 

.Oi 

9u,4 

£— >7 - .016 


. 01 

.02 

.01 

>0.4 

7 -- >£ = ,016 


BP 

LP 

LR , 

LI 

TRRhSlTlUh LlhKS 



'C'Cp^ 

SEC 







£— >3 ^ .£56 

■ r. ■ 

.91 

.12 

.46 

,90 

.19 

,12 

5.3 

9.4 

3— >2 = .2S£ 
2— >5 = .179 




5 — >£ .154 

£ 

. 06 

.20 

.09 

12,7 

£-~>4 = .000 
4-^->£ « .000 

i 

.01 

. 02 

.01 

101.2 

£^->7 s= .026 





7—>£ s . 026 


BP 

LF 

LP . 

LI 

TRRMSITIDN LIhKS 




.SEC* 

SEG 

£— >3 ~ .1£5 


•7C- 

.49 

.24 

4.2 

3 — ->£ — .£08 


ilS 

.20 

.10 

10.0 

£— >5 = .292 
5— >2 = .208 


.11 

.29 

.14 

7.2 

£—.)4 = .000 
• 4 — >£ =r .000 

4 

.04 

.04 

.02 

50.1 

£— >7 = .042 
7— >2 = .042 


BP 

LP 

LR^, 

1 

trrmsitidh lihks 




SEC 

SEC 







£““>3 = .1£8 


,16 

.45 

.20 

.30 

.13 

3.4 
7 .5 

3— >2 ~ . 205 
£— >5 “ .256 

'■ f: 




5— >2 =* .154 


,13 

o*=i 

.17 

6.0 

£^->4 = .000 

"f 





== .000 


,10 

.1 0 

.07 

15.1 

2— >7 “ .051 
7— >£ = .103 

i 

■■f 

BP 

LF 

i_P* 

t LI 

trrnsitiom lihks 

;'2t 


SEC 

' SEC 


■ i 


0,*f 


1.2 

.49 

.44 

,34 

0 .6 

.24 

.31 

w 24 

0.4 

.09 

.11 

.09 

0.0 

,01 

.02 

.01 

1.5 

,11 

.07 

.05 

0.4 

.07 

• 

.04 

SB 

BF 

LF ' ■ ’ 


'SEC 



sec ' 

0.6 

. 5*3 

.47 

.54 

0.3 

,21 

.20 

,23 

0.1 

.09 

.14 

.16 

0.0 

.01 

.01 

. 02 

0.2 

.06 

.10 

.12 

0.5 

.11 

.07 

.03 

SB 

BF - 

LP 

LP.j 

-r tr *“‘ 



SEC 

0 . 6 

.61 

.49 

.56 

0.2 

.17 

• IS 

.21 

0.1 

.02 

,05 

. 06 

0,1 

. 03 

.06 

.07 

0.2 

.12 

.21 


0.5 

.03 

,02 

! o 2 


1. .3 


£— >3 = 

3 - ->£ « 

>5 

5— >£ - 
£— >4 

4 - ->£ = 
2-r>7 « 
7— >2 = 


TRRMSITIDN LIHKS 

£— >3 ^ ^159 
3— >£ = .174 
2— >5 = .014 
5— >2 = ,000 
£-'->4 = .130 
4 — >2 - .120 
e— >7 = .053 
7— >£ = .053 


TRRMSITIOM LirU7 

£— >3 = .153 

3— >£ = .178 

£— >5 = ,049 
5— >2 .049 

£— >4 = .049 

4- ‘\'>£ = .043 

£— >7 .018 

7— >£ = .012 
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TABLE E-6 (Concluded) 
b. Run 155 


I MCI) 1Ji 

<»r*- 


TMX THH 


n 




fi!* 


I t. 


•riri*** 


LI TRftNSITKIN LIHKS 


PI ^505 




re.J:- 

O.S 0 . 4 


jp-s ’?«0.4 iH' 

N - 

tK- O.Si 1> 


«• ;r> ^ 


O.*:- O.^* 

1 .*5 


•4 . 3 


o.r 

C.’5 


9 0 

I fKI> 


TD 

f cr 


1m: TriH 


Pi CSO^ 

yp lZ-1^ 


t 


0 

10 


’ ‘• 4 . 


:• • 0 


E;4 .3 

1 .5 


0 .*:♦ 
0.4 


TR'lOl . I SEC. 
ti ^ J 

0.19 l/SEC 


0 

I 

0 

0 


9.0 


£ . 0 E . 0 


Pi Rl^Ci C909 
WP IS;- 19 3M;^P 


?K1> TD 

•rcr 


TMK 

'"cr 


TMM 

e'er 


TR- <49.9 SEC 

M ^ 15 

S;R= 0.30 1-^CEC 


S -42 .9 
7.2 

0.5 


12.0 
2 . 0 


0.5 0.5 


I 1KI> TD 


TfiX 

•rcr 


Tf-tH 

-rcr- 


PI PI 55 C302 
WP 13-21 3MPF 


1 


0 


TP“ 59.9 SEC 

M = IT 

SR- 0.22 1 /SEC 


3 

0 

0 

0 


2.4 


17.0 

1.3 


ij.4 
0 .4 


7 

9 


1,2 OiS 


5.1 

0 .6 

fi.l 

.04 

0,6 

0.0 

.01 

1 .0 

0.2 

1 .9 

.06 

.05 

TD 
Z EC 

CD 

«■ err 

Ilf- 

9.4 

0.6 

7.1 

0.4 

.97’ 

,05 

2.0 

0.0 

. 02 

TF 

SEC 

SD 

SEC 

DF 

1.2 

4.1 

0 .5 

C;*? 

.14 

0.5 

0.0 

.01 

TB 

SEC ' 

SD 

SEC 

DF 

5.3 

0*3 

5 .6 

0 .4 

.33 

.04 

1 .0 

0.2 
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TABLE E-8a. TSANSITIOH LINK MATRICES FOR RUNS 261 AND 257 


CaNDITIDN ! P4 R261 C201 UiP 4-6 20MftR 

all INSTRUMENTS 


1-URY TRRNSITiaN LINK 


.009 
. 009 


,009 

.200 

.300 

.009 
.013 .013 

.032 .064 

.009 .027 


. 036 . 1 55 

.009 


009 

,009 

.009 


, 009 


.009 


CGND I TION • R4 R257 C2 02 WF 4-6 2 ONRR 

RLL INSTRUMENTS 


1-W3V TRRNSITiaN LINK2 

3- : : , 4’ ' : 5 ^ ^ 6^' 




,011 


2 .Oil 


.293 


.022 .109 .054 

.022 


4 


022 

,120 .011 

, 022 . 033 
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TABLE E-8b 

CnMIiITIDN ; P4 R261 C£01 WP S-9 

aLL INSTRUMENTS 

l-WflV TRANS IT lUN LINKS 
1 £ 3 4 5 ' 6 


•j 

4 

5 


034 


, 034 


A "mf w* 


.169 


.034 

.136 .017 

. 0 1 r' .01 


.051 .136 

.017 

.017 


017 


.017 


CONDITION : P4 R£57 C£G£ WP S-9 20MRR 

1-WflV TRANSITION LINKS 

: :■■ -1 ' 3 ". 4 / ■ 5 ;:’ 


4 


091 


114 


1S£ 


.£05 


, 045 
,159 


.045 .136 
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TABLE E-8c 


CDML I T I Dr< : F"4 F £6 1 C£ 0 1 UiF £-13 £ 0!' 

F.LL XH:TF'JMEHTS 

1-WFtY TPSMSITID?-i LINK^ 



1 


3 

4 5 


1 


.1£9 



.01 

- 

. 14 0 



.011 

. 04 



.£53 




4 






5 



.011 



^*4 

.011 

.043 

.011 



1 ' 

.011 

.0££ 

. 032 






019 

05S .019 
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TABLE E-9a. TRANSITION LINK MATRICES FOR RUNS 156 AND 157 

Cahl'ITIDh i PI P156 C£01 '‘iPV FT.: 4 TB € 

ALL ItiCTRUHEMT.:-; 

1 -MAY TRANSITION LINKS 
1 £ 3 4 5 6 7 

1 



6 


CONDITION : PI R157 CSOS WRY PTS 4 TO 6 3MfvR7S 

RLL INSTRUMENTS 

1-WRY TRANSITION LINKS 
. 1 ^ 3 4 5 R , 7 ^ 


3 

4 


*294 .029 


.17S 


£94 
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TABLE E- 9b 

CDHI'ITIOh : PI P15P CTOl I.IBV PTS S TD 9 Ot-.FtP' 

RLL IHSTRUMEhTS 

TRfihilTIDh LINKS 


piO l“iCro 

• U. i W a U C' 


.019 


COHDITION s PI R157 C£02 WfiV PTS S TD 9 3MSF" 

RLL THSTRUNENTS 


1-IJRY TRRNSITIDN . LINKS 




.167 
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TABLE E-9d 


CDhDITIDN : PI PI 56 CE’Ol Uifi’V PTS 1£ TD 14 

RLL ir-iSTRUMEHTS 

1-I.IRV TRfiMSlTIQM LlRKG. 

1 £ 3 4 5 t. 

1 

£ . 05 0 .450 

3 . 050 

4 

•5 .450 


COrmiTIDH : PI R15? C£0i I'lRY PT3 1£ TD 14 

RLL IHSTRDrTPriTO 



1 -WRY TRRRS I T I DM LIMK3 

£t; . ■ 3 - X 4 : 5 6 

314 
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TABLE E-10a.. TEANSITION LINK MATRICES FOR RUNS 154 AND 155 

COnitlTIDN : PI R154 C301 WfiV PTS P TC 9 3MftR7S 

RLL irtSTPbt'lEHTS 


l-WRY TRRrrSITIDH LINKS 


CDHIiITlDH : PI P155 C3Ga WRY PTS 8 TD 9 SMfiPviS 

RLL INSTRUhEHTS 


1 -WRY TRRHS I T I DH LI NPS 


.£14 


.036 


179 .01 
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TABLE E-lOb 


CDhI’lTICH : PI R154 C:?ni I.IPY F-TC 1? T 

TILL IhSTPUMftn 


TRRHSlTinN LINK 
3 4 5 . 6 


.£56 


.179 
. 026 


154 .051 


. 0£6 


CDRUITIOH : PI R155 C3 02 U'RV PT2 12 T 



1-l.jRY TRRHSITIDM LIHH 
£ 3 4 5 6 

.444 

444 


056 
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TABLE E-lOc 


COriimiOH : PI R 154 GO 01 .P'T5 15 T 

RLL INSTRUHEf-fT 

1-wBV TRPH-:iTiari link; 
1 £ 3 , 4 5 O 



. 04 £ 


CDhl-lTIDh : PI R155 CflOE 3 02 WhY PTS 

ALL IHSTRLiMEHT 

■ -1 ••:; ■ ■ ;: ■ ; ;3 : ■ : 4^'^ ; 5 ■;■ 6 

1 ■ 

c' . 4 c! 9 . IJ I’’ 1 

4 .' 

"S'- .. .071'. ' , . 
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TABLE E-lOe 


COHDlTIDfr : PI PI 54 CC Ol WHV FTS . c ), TO 22 3MFP76 

FILL iritTPUNEHTG 


1 -WFlY IRfiriS. I T I OH L I HKS 


»ieo .017 


.050 .017 


.017 .032 


COHD I T IDH : P 1 R 1 55 C3 02 WRY PTS 21 TO 22 3HPR; 


RLL IHSTPOHEHTS 


1-WBY IRRHSITIDH LINKS 


.316 


. 263 
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TABLE E-lOg 

;;Ohf iTicr-i 

: FI Fl!54 C 

301 PT3 £5 T 



Fill IH3TRUMENT 


1 — 

TRRHSITIDH LINK 

1 


4 5 ■ 6 

1 




.153 

.049 .049 .£0 

3 ■■■ ■■ . 

• 1 1 ’ 0 


4 

.043 i.OOt 


5 

.049 .006 

.00 

•5' . 

.196 .013 

. 0 06 : 


. 0 1 £ 

.006 

□NIUTIDf-i 

: Pi PI 55 C 

30£ WRY PTS £5 T! 



FILL INSTRUriErfT: 


1-UlfiY 

TPfiHSITIGN LINK 

; 1 - 

3''' 

/■ ;4; 5^ . ^ '•6L 




^ 2 * ■ ■ ■■ .. - 

t- ■■ 

' .313 



.313 



■ 1 
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TABLE E-lla. TRANSITION LINK MATRICES FOR RUNS l48 AND 1 49 
RtiTEP DF^TR FILE HrihE : HRflb 

COhDITIOH : P3 F14S GbCiJ WfiV .FTS 8 TO 9 1MBR76 

fiLL IHSTRUMEHTS 


i-l,!RY TPfihTITICN LIMK3 
1 £ 3 4 5 ' 6 7 

1 .008 .008 .008 
£’ . 0 1 ^ ^ ^ ^ ^ .156 .033 .156 . 085 .033 

3 .156 .008 .041 

4 . 0£5 ,008 .009 .008 

5 ’ ^ .197 .085 

6 .008 .008 .008 . 016 ^^^^^^^^^^^^^^^^^^^ 



'. 008 


CDHD I T I OH : P3 Ri49 :,C5 0£ UlpY PTS 8 TO 9 1 HPR76 
• IH3TRUMEHTS ^ 

l -ypY TRRHSlT XnH L I HKS^^^^ 

; • v;: /'I / ::: z: r -^bY'T \ 7^ — 

3 .147 .015 

4 . 089 

5 .16£ 

6 

7 .118 .015 
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TABLE E-llb 


CDNDITIDN ? F2 P14& CSOl ••.'A’l FTS Ic TD 15 1MRR76 


ALL instrumeht:; 


i -1.1ft V TRftNSITIDH LINKS 


. 01 2 


.012 


. 024 


084 .048 .217 .012 . 08 0 


. 1 OS 


. 024 


.036 


.217 .024 


.012 


. 012 


• U4S • Oc*6 


f R14S C302 WftY PTi 12 TD 1-* l.-ft.-. -- 
fiLL INSTRUMENTS 


1 -WFl V TRFINS I T I ON L 1 NKS 


.100 .075 .200 .012 .050 


. 025 


.012 


.012 


js 
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TABLE E-llc 


COliriTID-. 5 P3 R14& WFiV PTS 15 TI 

PLL INSTPUMEHT;: 

1-WfiV TRfiHSITIOr^ LIhK 
1 £ 3 4 5 6 ■ 

• Li I ■ I. ' c -jri ■ ■-*' »' c.' 

.047 
. 033 
.395 . 

. 047 



COHDITIOH 4 P3 R149 C302 WftV PTS 15 T 

RLL INSTRUMENT 

1-WfiV TRANSITION LINK 

1 : ■ £ : : V 3 -4 : ; 5 ■ ■ ' 6 

' 1 



.190 
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TABLE E-Ild 


CDHrtlTIDh : P3 FT3 IS TO £1 IMFlF 


ALL Ihr.TRUMEtns 


1-WflY TRANSITIDM LIHKS 


.115 .269 .019 


.£50 .019 


CONIiITIDH : P3 R149 C302 WRY PTS IS TD £1 IMRR 


RLL IHSTRUf'lEMTS 


1-WRY TRRNSITIDH LINKS 


.250 
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TABLE E-lle 


CDhriTIGN 

: F3 

PI 48 13: 

301 WRY PT3 21 TE 




RLL IH:S7RUMEMT:: 



1 -ijlRV 

TPRriLlTin:-: LIMK: 

1 

cl 


4 5 6 

1 




c. 


.106 

. 059 .200 , 01; 


.1 IS 


.01; 

4 

. 035 



5 

.176 

.024 


6 

.r;c4 



■ ' . '‘1* ■ 

• 1 06 




.012 



CDhlilTlDh 

: P3 

R149 C 

302 WfiV PTS 21 T! 




RLL IH3TPUMEHT 



1-WP‘ 

V IRRHSITIDM LIHI 5 

^1' ■■ 

■*—■■■■ 

3 

: ■ ;4 ; '5 -..S' 




. ^ 0 . .01 



: .213^- 

.1 07 .053 

;-a . o iq 

• l?rvi* 


.01 

c/'::::4 ;;v.:''/':V:,:: 

.120 




.053 



6 

.013 

.013 


■ i . ■' 

. 067 

.013 


Pi 



.013 
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TABLE E-Ilf 

CCHHITIOM : P3 

R14S ( 

1:3 01 WRY Pl;3 22 TL 




RLL IMSTRUMENTS 



l-WR*i 

i' tf:rh;sition lihk;s 


1 £ 


4 5 6 

1 

. 023 



CL 

.011 

.046 

.0:34 .276 .034 


. 08 0 



4 

. 034 



5 

.264 

. 023 


6 

.011 .011 

.011 


r 

.05? 


.011 

CDMDITIDh : P3 

R149 

C.302 WRY PIS 22 T! 




RLL IN:3TR'JMENT 



1-Wl=l 

V TRRNSITIDH LINK: 


1 £ 

3 

4 5 6 

1 

.017 



, , ^ ■ 

.017 

.186 
. 1 02 
.085 

. 085 

.136 

. 102 ; . 1 02 ■ V 

;v ■4:; 

5 

6' 

' 


O ' 

.017 
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TABLE E-llg 

CONDI TIGH : F":-‘ C3ul WRV PTS 35 TO 29 IMRRl 

fiLL IHSTPUMEHTS 


IHIRY TRRHSITIOH LINK 
1 2 3 4 5 6 

1 .019 

£ .019 .031 .033 .239 .05 

3 .081 

4 .006 .031 

5 .£6£‘ .006 

6 ■ ' . 056 


. 025 
. 0 06 


. 0 1 R 
.0 06 


. 006 


CDHIUTION : P3 R149 C302 MRY PTS 25 TO 29 IMRR 

RLL instruments: 

1-I...IRY TPRNSIT ION LINKS 
1 2 3 4 5 6 7 


018 


4 


.018 

.211 

. OSS 
.1:32 


. 044 .009 


.202 L . 098 .140 


044 


009 


e-56 
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INSFIRATIONS FOR EYE MOVEMENT STUDIES IN 
FLIOHT CONTROL AND MONITORIITG TASK 

(From Ref. 1*) 

The measurement of pilots* eye fixations and movements about the instru- 
ment panel within the cockpit has attracted research for over a quarter of a 
century (e.g., in Ref. 2, see Refs. 67 - 77 , 82-95, 95, and 96 ) . Rot surpris- 
ingly, the motivation for the earliest available results seems to have been 
to Gon^are pilot fatigue under instrument flight rules induced by differences 
in "scanning workload" among instruments between the Standard ( circa 1944 ) 
Army Air Force and Royal Air Force instrument panels. To explain statistic- 
ally significantly different e;jq)erimental results on the two different panel 
arrangements., an embiyonic display arrangement hypothesis was set forth in 
1 9 I 1 . 4 : "Differences between the time spent on the various instruments in the 

two panel arranganents may be explained by the hypothesis that pilots tend 
to spend more time on the centrally located instruments, and particularly 
on the instrument located in the top center position. While not definite, 
this finding suggests that instrimaent panel designs should place the most 
important instrument for instrument flight in the top center position of 
the panel, and the next most important instrument in the lower center 
position." (From Ref. 67 in Ref. 2) 

Other early studies of eye movements of flight personnel were concerned 
with open- loop signal detection, for example, searching for targets on radar 
scopes, monitoring multi-engine perfosmiauce for threshold- exceedences, and 
establishing minimum visual angles external to the coclq)it under visual 
flight rviles . 

However, the inspiration for much of this eye movement work was founded 
on the belief that the cues used by the pilot in controlling flight would 
be revealed by noting the (separated) instruments upon which the fovea of 
the eye was fixating inside the cockpit under instrument flight rules, and 

^Unless otherwise noted, reference numbers in this appendix refer to 
reference list at the end of this appendix, page F- 6 . 


by correlating the directions of fixations ejcbernal to the cockpit with 
significant ground-based cues in landing approaches under visual flight 
rules. Information about the useful instrument flight control cues was 
believed to be fundamental to an understanding of the function served by 
flight instruments. It was expected that this understanding would, in 
turn, form a basis for improving the design of aircraft instruments, 
increasing the efficiency of instrument fli^t training, and simplifying 
the task of instrument flying. 

Today we are still working to fulfill this expectation, because the 
premise on which it was founded twenty years ago has been shown to be only 
a partial truth for several reasons. Pilots develop an ability to operate 
effectively on parafoveally and peripherally perceived information (Ref. 3), 
albeit with some limitations (Ref. ij-), and, of course, on reinforcing (i.e., 
nonconflicting) motion and aural cues. Further, there is considerable in- 
direct evidence (e.g., Ref. 5) that in ''stare mode" circumstances fixing 
the eye-point-of-regard serves merely to stabilize the eyeball for good 
parafoveal viewing, so that the fixation point may be unconnected with the 
information actually used, or even perceived, by the pilot. ¥e cannot say 
that what is being fixated necessarily corresponds to an input. 

The inspiration for the earliest pilots’ eye movement studies — - that 
scan patterns might be useful for workload measures — - was revived more 
recently in Ref. 6. While scan patterns are indeed relevant to workload, 
the connection is not simple. Ine eye requires fixation to keep the eye- 
ball stable, so there is a kind of Parkinson’s Law for the eyeball — the 
sum of the fixation dwell times on the instruments expands or contracts 
to equal the time available (neglecting saccadic times). There is, of 
course, a minimum dwell time of about O.ii- sec per instrument, so it is 
possible to contrive saturated conditions where the control task demands 
pilot fixations on too many instruments too often in order to maintain 
control. But the interpretation of such results would often be ambiguous 
if one is looking for the pilot’ s inputs . 

The early eye movement studies referenced above considered fixations 
as a function of the overall pilot- aircraft system task, such as landing 
approach, but completely apart from the controlled element dynamics . To 
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get at the total "pilotahility" problem, we proposed some years ago that 
pilot- aircraft system dynamic techniques be applied to the display area. 
Under coordinated NASA- ARC and JANAIR sponsorship we have in the last four 
years developed, refined, and elaborated a theory (Refs. 2, 7, and 8) 
applied it to a number of interesting situations (Refs. 7, 8, and 9)^ ^-bd 
have supported and augmented the. theoretical development in crucial areas 
with experimental efforts (Refs. 9 } 10^ and 1 1 ) . 

SCAMING lOTIOMENA TO BE^ 

Scanning of an instinment panel permits the displayed information to 
be sanpled foveally. The foveal fixation dwell time interval is variable, 
but averages about one-half second among conventional separated flight 
instruments and one second or more among integrated or combined flight 
instruments. Information outside the foveal region may perhaps be observed 
parafoveally. One can measure the transition of foveal fixation between 
two instruments and the pause or dwell of the visual axis of fixation on 
an informative part of the instrument (for example, the tip of a pointer) 
before beginning the next transition. Measurements have shown variability 
in the time interval which elapses between successive fixations on the same 
instrument. This time interval is called the scan interval or sampling 
interval. It will, in general, exhibit a different ensemble average value 
for each point of fixation. Besides instrument- to- instrument scans, scan- 
ning may occur among the elements of combined displays, or between a display 
and a point of regard in the external visual field during IFR-to-VFR tran- 
sition. 

Besides instrument- to- instrument scans, scanning occurs between elements 
within combined or integrated symbolic and pictorial displays . For example, 
secondary fixation transitions within the two-axis attitude director on 
various symbols , indices, and scales have been observed in the experiments 
of Ref. 10. Among several pictorial examples of pilot's scanning patterns 
on different instrument panel arrangements in Ref. there is shown an 
internal pattern on an integrated contact analog display. Obviously, one 
must speak of a foveal scanning pattern among "symbols" in the case of the 
contact analog or some other integrated display, rather than among "instru- 
ments" as we shall do in most of what follows. 
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Purthermore, an observable foveal scanning pattern may be accompanied 
by a parafoveal scanning pattern of awareness which is not directly observa- 
ble by measuring eye movements . However, the presence of parafoveal awareness 
is indirectly observable by its influence on the pilot's describing function. 

Although we shall be speaking primarily about the visual modality, the 
pilot can also choose to use or ignore motion and aural cues. While this 
is not quite like sampling, the more, or less continuous use of the vesti- 
bular or aural modality is akin to a process of selection when these cues 
reinforce the visual modality. 

The proportion of the total number of fixations which fall upon a parti- 
cular -instrument is called the average look fraction for that instrument. 

Its upper bound is one-half, which implies that every other fixation or look 
is on that instrument having a look fraction equal to one-half. 0?he look 
fraction represents the ensemble probability of fixation for each instrument, 
and the sum of all look fractions on the instrument arrangement must equal 
unity. 

The proportion of the total time, during which fixations dwell on a 
particular instrument is called the average dv/ell fraction for that instru- 
ment. Since the, cumulative sum, of all dwell fractions, including blinks 
and distractions, must also equal mity, by definition, the dwell fraction 
is also termed "fractional scanning workload" or "temporal probability of ; 
fixation." \ : ^ 

The. proportion of all fixation transitions which go in the same direc- 
tion between a pair of instruments is called the "one-way link-value" in 
the specified direction. The sum of the two one-way link-values between 
a pair of instruments is called the "two way" link value. In 1950, new 
research extended the display arrangement hypothesis of 19^4 to suggest 
that the pattern of link values between, instruineats .is indicative of the 
goodness of different panel arrangements . Since, in point of fact, the 
scanning statistics are quite stationary over measurement intervals as 
short as 100 sec, different one way link values between the same pair of . 
instruments are also indicative of determinism in scan patterns. The 
results in Ref .10 show no evidence of circulatory determinism in scann- 
ing traffic. This simplification proves useful in making predictions of 
scanning behavior. 

P-4 
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The pilot using a flight director or automatic system for control wants 
to spend a certain amount of time monitoring the confidence- inspiring situa- 
tion information. This is how he gains and maintains confidence in the 
flight director or automatic system. ¥e speak of this time that he spends 
monitoring the situation information as his monitoring workload margin . 

It can he expressed either as a fraction of time, the dwell fraction, or 
as the fraction of the numher of looks, the look fraction. Sufficient 
monitoring margin is essential to the pilot to perceive exceedence of 
tolerances or specified values related to the task. Most of the pilot’s 
status displays present the flight motion variables which are constituents 
of the automatic and flight director commands. Other status displays are 
common to engine or radar instrument monitoring, where the effects of manual 
control are not displayed. 

One purpose in the research reported in Refs. 12 and 15 has been to 
iit^rove the models for predicting the partition of the pilot* s time between 
the monitoring margin and the fraction of time required for control. Esti- 
mates of average monitoring display threshold exceedence frequencies in 
terms of a level of pilot confidence in his situation, coupled with two 
conservative principles, viz. , the conservation of look fraction and of 
dwell fraction, provide the basis for the partition of scanning workload 
for monitoring and control. The results of the partition provide estimates 
of the average scanning frequencies, dvrell intervals, look intervals, link 
values, and other scanning parameters for monitoring and control. 

The principal cost of the pilot *s scanning behavior is an increased 
"remnant" which depends on the scanning frequency, variations therein, and 
the fixation dwell interval, as well as the variance of the displayed (and 
perceived) signal. The remnant acts like an injected noise and is the real 
cause of saturation in using multi-instrument displays, because it may con- 
spire to coii 5 )romise the pilot’s confidence in his situation, to compromise 
his performance, or both, so that his subjective impression of the overall 
task workload will be high. So, as we said at the outset, the measiirement 
of eye fixation is certainly connected with pilot inputs and workload, but 
the connection is by no means a simple one. 
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APPENDIX G 


CaiAPHICAL SUMMARIES OF SAMPLED TRACKING ERROR STATISTICS 
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APPENDIX H 


ANALYSIS OF VARIANCE IN EXCESS CONTROL CAPACITY AND 
CAUTION ADVISORY RESPONSE TIME 


TR-10T2-1- V H-1 


TABLE H-1 



TESTS OF SIC2IIFICAWCE IN DIFFERENCES BETWEEN MEAN EXCESS CONTROL 
CAPACITIES WITH FLIGHT PLAN 2 AND PILOT 1 (Ec = 1 . V) 



DISPLAY RUN NUMBER 

MFD 139 

HSI 142 

95^ FIDUCIAL INTERVALS FOR 

DISPLAY, 

EXHIBITING 


DIFFERENCES 

C5REATER 
MEAN XSCC 





Number of Sanples> n 

784 

741 

^.05 == 0.0086 (Behrens) 


Waypoints 

Mean XSCC, mj 

0.145 

0.196 

m*|42 — °^139 = 0-051^ 

HSI 

V-h^3 

Stanciard Deviation, s j 

0.104 

0.063 

D.05 = 0.0087 



Standard Error, s j/Vn 

0.0057 

0.0023 

(Scheffe or Tukey) 




412 

387 

^.05 “ 0.0083 (Behrens) 


Waypoints 

Same as above 

o.o8o 

0.093 

mi4g — = 0.013 

Neither 

3 -^5 


0.047 

0.070 

®.05 ■ O*O082 




0.0023 

0.0035 

(Scheffe or Tukey) 




486 

488 

^.03 ” 0.0103 (Behrens) 


Waypoints 

Same as above 

0.146 

0.130 

m|^^ — ^l42 ” 0,016 

Neither 

5 —7 


0.062 

0.098 

D^05 = 0.0103 




0.0028 

0.0044 

(Scheffe or Tukey) 




604 

667 

D^05 0.010 (Behrens) ' 


Waypoints 

Same as above 

0.105 

0.076 

• mi 39 - m*|42 = 0.029* 

MFD 

7 -^9 


0.098 

0.086 ! 

D.05 = 0.010 




0.0040 

0.0033 

(Scheffe or Tukey) 




471 

445 ' 

D.05 = 0.011 (Behrens) 


Waypoints 

Same as above 

0.156 

0.166 

“142 ~ ®139 ” 0.010 

Neither 

9-^11 


0.062 

0.096 




0.0029 

0.0046 

^ = 0.0104 (Scheffe) 

.05 = 0.0105 (Tukey) 




4ll 

472 

D.05 = 0.004l6 (Behrens) 


Waypoints 

Same as above 

0.236 

0.227 

mi — m-, 1^2 = 0.009 

Neither 

11 -*-15 


0.0136 

0.0432 




0.00067 

0.0020 

D_o5 - 0.00436 






( Scheffe or Tukey) 



‘Difference between means significant at 0.05 level based on Behrens'# Scheffe's, or Tukey's tests ' 
(Refs. 25-27). 


TR-T0T2-1 


H-2 









TABLE H-2 


TESTS OF SICJHIFICANCE IN DIFFERENCES BETWEEN MEAN EXCESS CONTROL 
CAPACITIES WITH FLIGHT PLAN 2 AND PILOT 3 (Ec = 1 .2) 

a. HSI MFD 60 






95]t FID0CIAL miEBYAlS 

DISPLAY 


DISKiAY RUN NU14BER 

HSI 59 

MFD 60 

FOR DIPFERENCES BASED 

EXHIBITING 




ON BEHREN’S TEST 

GREATER 
MEAN XSCC 



Number of Samples, n 

785 

721 

D.05 = 0.010 


Waypoints 

Mean XSCG, mj 

0.165 

0.167 

= 0.002 

Neither 

1-^5 

Standard Deviation, Sj 

0.093 

0.102 




Standard Error, Sj/^n 

0.0033 

0.0038 





37i+ 

395 

No test needed 


Vlaypoints 

Same as above 

0 

a 

0,240 (max) 


Neither 

3 5 


Not Aj)pli cable 

Not Applicable 


. 



t29 

445 

d,o5 = 0.010 

. 

Waypoints 

Same as above 

0.24 o (max) 

0.118 

^9 ~ ^60 “ 0-122* 

HSI 

5 7 


Not Applicable 

0.090 

0.0043 





5311 

530 

D.05 - 0-011 


Waypoints 

Same as above 1 

0.11+1 

0.062 

"59 “*"60 = 0.079* 1 

HSI 

7 -*-9 


0.105 

0.074 




0.001)5 

0.0052 





458 

386 1 

D.05 = 0.0078 


Waypoints 

Same as above 

0.162 

0.086 

"59 “ ®6o ® 0.096* 

RSI 

9 — 11 


0.065 

0.051 




0.0030 

0.0026 





451+ 

'^'440 

®.05 = 0-0065 


Waypoints 

Same as above 

0.046 

0.019 

"59 ~ *60 “ 0.027 

Neither 

11 -►15 


0.064 

0.029 




0.0030 

(Skewed 

distribution) 

0.0014 




*Differenoe 'between means significant at 0.05 level based on Behren's test (Kef. 25). 
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TABLE H- 2 (Concluded) 
b. HSI 58) MFD 56 



DlSELAy RUM NUMBER 

MFD 56 

Hsr 58 

95 f fiducial intervals 

FOR DIFFERENCES BASED 
ON BEHREN'S TEST 

DISPLAY 
EXHIBITING 
GREATER 
IvlEAN XSCG 

Waypoints 
1 '*>' 3 

Ntimber of Samples, n 
Mean XSGC, 

Standard Deviation, s j 
Standard Error, sj / ^n 

889 

0*179 

0.097 

0*0035 

835 

0.169 

0.100 

0.0035 

0^05 =0.0095 

®56 ~ >*58 = b .010 

Neither 



561 

1220 

1^.05 


Waypoints 

Sarae as above 

0.240 (max) 

0.074 

“ n^3 = 0.166 

MFD 



Not Applicable 

0.079 






0.0023 





435 

No Data 



Waypoints 

Same as above 

0,240 (max) | 




5-^7 


Not Applicable 





— ^ — ^ 

506 

No Data 

■ ^ • • • 


Waypoints 

Same as above ' 

o.i 4 o 


. ■ 

■ . ' ' ' 


7 — 9 


0.093 






393 

No Data 



Waypoints 

Same as above 

0.046 




9 -*-11 


0.058 






366 

No Data 



Waypoints 

Same as above 

0.067 




11 -►IS 


0.058 





* Difference between means significant at 0 ^05 leveX based on Behren* s test (Ref . 25 ) . 








TABLE H-5 

TESTS OF SIGNIFICMCE IK DIFFERENCES BETWEEN MEAN EXCESS CONTROL 
CAPACITIES WITH FLI(2iT PLAN 5 AND PILOT 5 (Eq = 1.1) 


8 10 


10 11 


DISPLAY RUN NUliBER 

MFD l46 

HSI 147 

Number of Samples, n 

759 

854 

Mean XSCC, mj 

0.067 

0.005 

Standard Deviation, Sj 

0.047 

Not Applici 

Standard Error, s^/ Jn 

0.0017 



486 

487 

Same as above 

0.153 

0.095 


0.084 

0.080 


0.0038 

0.0036 


951^ FIDUCIAL INTERVALS 
FOR DIFFEREKCES BASED 
ON BEKREN'S TEST 

= 0.064* 


D.05 = 0.010 

mi46 - milvY = 0.058* 


display 

EXHIBITING 


Waypoints Same as aLove 

11-^14 


Vraypolnts Same as above 
14-*- 18 


Waypoints Same as above 
18 -*-25 


Waypoints Same as above 
25—29 


621 
0.038 
0 .054 
0.0022 

,61 6 
0.117 
0.107 
0.0043 

1195 

0.094 

0.106 

0.0031 


1650 

0.175 

0.087 

0.0022 


587 

0.065 

0.094 

0.0039 

816 
0. 102 
0 . 102 
0.0036 


D.05 = 0.0088 

miL7 “ m,t.6 = 0 .0^* 


D.05 = 0.011 

®l46 ^ mi 4 y = 0.015 


0.05 = 0 - 007 ^ ^ 

- mii^j4= 0.069 


(Skewed 

distribution) 

0.0018 

1651 

0.113 

0.109 

0.0027 


d,o5 = 0.0068 
»146 ~ mi 47 = 0.062* 


Neither 


Difference between means significant at 0.05 level based on Behren^ s test (Ref, 25) 


ORIGINAL PAGE IS 
m BOOR QUALITY 
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lAELE H-1+ 


i:,:. .#1 i. 


TESTS OP SIC2JIPICANCE DT DIPFEEENCES BETWEEN MEM EXCESS CONTROL 
CAPACITIES WITH FLIGHT PLM 2 MD PILOT k (Eq = 1 . 1 ) 

a. HSI 164; MFD l63 






95^ FIDUCIAL INTERVALS 

DISPLAY 


DISPLAY RUN NUMBER 

MFD 1 63 

HSI 164 

FOR DIFFERENCES BASED 

EXHIBITING 





ON BEHREN'S TEST 

GREATER 
MEAN XSCC 


Number of Samples, n 

760 

753 

d,o5 - 0.0076 


Waypoints 

r 5 

Mean XSCC, 

0.130 

0.116 

®163 ~ “l64 = 0.014* 

MED 

Standard Deviation, Sj 

o.lOT 

0.113 


. 


Standard Error, sj/yil 

0.0039 

O.004l 





403 

388 

D_q5 = 0.0118 


Waypoints 

Same as above 

0.087 

0.067. 

“163 “ “169 

, 

MFD 

5 —5 


0.098 

0.068 




o.ool ^9 

0.0055 





429 

425 

D _ o 5 - 0.0122 


Waypoints 

Same as above 

0.113 

0.136 

*164 V ®i63 = °’° 23 * 

HSI 

5 -^T 

\ 


0.082 

0.098 



. 7 ’ ■ ■ 1 

! 

o.oo 4 o 

0,0048 





583 

499 

D ^05 = 0.0125 


' Waypoints 

Same as above 

0.074 

0.116 

*164 - "163 = 0 -042V 

HSI 

7-^9 


0.101 

0.107 




0,0042 

0.0048 





565 

469 

D _ o 5 = 0.01 


Waypoints 

Same as above 

0.158 

0.105 

®163 “ *164 - 0-°53* 

MFD 

9-^11 


0.090 

0.070 




0.0038 

0 .0032 





413 

432 

D . q5 = 0.006 


Waypoints 

Same as above 

0.234 

0.131 

*163 “ “i 64 = 

MFD 

11 -*“15 


Not Applicable 

0.069 
0 .0033 




*Difference 'betweea means ; significant at 0 .05 level based on Behren' s test (Ref . 25 ) • 
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TABLE H-14- (Concluded) 
b. HSI 256> MFD 260 







DISPLAY 

DISPLAY RUN KUIffiKR 

HSI 256 

MFD 260 

95i FIDUCIAL IMTERVALS 
BASED ON BSHRER'3 TEST 

EXKIBXTII^G 
GREA.aER 
I/EAN XSCC 


Number of Samples, n 

Waypoints Mean XSGC, m4 
1 5 

Standard Deviation, s^ 
Standard Error, sj/yn 


Waypoints Same as above 
3 ->-5 


Waypoints Same as above 

3 


Waypoints Same as above 

7“^ 9 


Waypoints Same as above 
9-^11 


Waypoints Same as above 
11 13 



0.090 

0.0056 

3U5 

0.053 

0.067 

0.0036 


0.090 

0.0038 


d, 05 = 0.010 
n'256 “ "’260 = 0.038* 


0.0086 
fflggo = 0.013 


(Skewed 

distribution) 

0.0012 

612 

0.058 

0.071 

0.0029 


( Skewed 
distribution) 

0.0025 

533 

0.086 

0.087 

0.0038 


D Q5 = 0.0078 
“260 “ “256 = 0.065* 


= 0.0066 

“256 “ “260 = 0.024* 


( Skewed 
distribution) 
0.0014 

388 

0.060 

0.050 

0.0025 


( Skevfed 
distribution) 

0.0018 

362 

0.112 

0.070 

0.0037 


D^q5 = 0.0078 
“260 - “256 = 0-°82* 


s = 0 « 006 
“256 “ “260 = 


(Skewed 

distribution) 

0.0018 


Difference between means significant at 0.05 level based on Behren* s test (Ref. 25) . 


Neither 
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TABLE H-5 


TESTS OF SK2TIFICAWCE IN DIFFERENCES BEOWEEN MEAN EXCESS CONTROL 
CAPACITIES VriTH FLK2IT PLAN 2 AND PILOT 5 (Ep = 1.1 ) 


DISPIAY RUN NUIvBER 



Number of Samples^ n 

Waypoints Mean XSCC^ 

1 ' - 

Standard Deviation; Sj* 
Standard Error; Sj/yS 


Waypoints Same as above 


I Same as above 



Waypoints Same as above 


Waypoints Saine as above 

9 n 


Waypoints Same as above 

11 15 


MFD 124 

HSI 125 

FIDUCIAL INTERVALS 
FOR PIFF,EP«CES BASED 
ON BEKREtF'S TEST 

DISPLAY 

EXHIBITING 

GREATER 

mm xscc 

T 4 ? 

0.188 

0.085 

0.0031 

815 

0.215 

0.058 

0.0020 

D.05^ 0.0073 
111125 “ ”*124 *= 0.027* 

HSX 

396 

0.238 

0.00640 

0.000322 

407 

0.190 

0.078 

0.0059 

No Test Needed 

^124 ~ ^125 ” 0 ,o 48 

MFD 

•<55 

0.063 

0.073 

0.0034 

521 

0.058 

0.050 

0.0022 

D.05 = 0,008 
mi 24 . - mi 25 = 0.005 

Neither 

525 

0.116 

0.082 

0.0036 

580 

0.086 

0.095 

0.0039 

D^05 = 0-0109 
^124 " ^125 - 0.050* 

KFD 

429 

0.114 

0.062 

0.0030 

652 

0.093 

0.094 

0.0037 

D^q^ =0,0094 
^124 ^125 ~ 0.021* 

MFD 

430 

0.228 

0.0240 

0.00116 

4 i 5 

0.014 

0.0248 

0.00122 

No Test Needed , 
mi 24 ” ^125 ” 0.214 

MFD 


Difference between means significant at 0.05 level based on Behren* s test \Ref . 2 p 


TR- 1 072- 1 



















L-SiOl- 





-1072- 


T 


coMpureg fAiLuiee) 


L£Ge/oT>r 


FlijKt PU#) 


PlUOT 

3 A t 

4 D C 

r © c 


CASE 

CASE 4><y: 
CASE IXA 


% 

0 CASC ZXX 


Bo<h H Si f M FD 

SKftJeJi 

-01 

Bo<R WSV i fA fO 

+Ta& 

-Di 

H5I 

o?e/vj 

-o4 

MFD 

09€A) + TAO- 

^05 


MAlf sf)A<ie 

-C8 

KfD 

HA^^ SMAa +TAGt 

-0^ 



-03 


f D 


4- inXicfttes excess coajT<?oL ci\p(\c\Ty 
lhftASt)Ae/iP>)C.n^: R^<^«iTioO 

■tt" \mA(ca^ tiS —{ "^i ra.MS w/ «»«.issecl <x^pnoa.cfu 


Ir -ii 


Lr 




Sf ?: 8 ^ 


Pa>nz<S Runs u 
\utHv 9n£. 4isplo^ 


s S 55 r cr§S&S^^£<ti-^fci" 52 SrS» 2 fiS & a 5 3 s 

_ Jl sc <m NW ^cJ< 4 c' 4 ^ 

U u tlj U Li t_t t_ ) 


i_» wer Response TTin^f Soir pAMTcJ RlOiS, 
wtflc display wl■H^ diVploi|£ 


H^V o 
MFt> z. 
W«.iWv^ 9 


RouT Data. O 
F(f 2- 


Figure H-5. Caution Advisory Task Response Times for Pilot k 




L^se/oD : 


Plan I 0 CASE- I XX 
% 0 cAse 2 XX 




B>o4k WS\ f H FD 

5V\A^e^ 

-o\ 

\-D 

SoiVWSV K HFP 

sKrtdteX +TM&- 

- 07 




095AI 




MFD 

OVe/v^ + T'^Cr 

-05 

t^D 

vy- 

H5I 

HaL? Sh-AcjlE 

^ OS 

T^D 

VjJ^ 

H FD ^ 

flA(f suit +'T^<S- 

“ 09 



duTo MptTc. 

'botTowi sKflAft 

-03 


+ m^icATfS EVceSS CoAfTRoL c/1 P>l c iTy 
me/l5o«eme,nT *n e<iiiTion ' 

rt- wciicft.+-es -IX mtti w/ a.ppro«.c(i. 


JLpwCi^ PttSpOVtf€ TTw^€ 4 Xor* Pa*rc<l 

{VC. di w> i 1 1» l>ei^{\. <l tS| 

fjSI I Ra-v^rDala 0 

MFD I n+Direclor ■2- 

JJc.i-'Hltv 4 o 


8 2 8 S = a 5 S £V 12 ^ S 5 K 3 ^ 

HSf R'ii'- ^ 

. U U U U ' 

Ru-wS t T 

Ov-C^ ttcSp 


Figure H-if. Caution Advisory Task Response Times for Pilot 5 



t-tigwT r,ai 2 3IX 

4 O CASt 4»X 


BoH MSI f Mpl> 
F& w/ BeHv (fE| f 
MSI 
WFI> 

P D w/ (4 i l 

pl> w/ MFD 


SkideJi 

Skade<^ 

Open 

Ope»» -*• Tas 
M alt Skactc 
Ucl^ Ska<ie 


•4- xwdicaVes aUru^nS U>/ i*<i*sse<i dpproe^k. 


Low eir RespoHS^c Wirfid 

one * ujcf’CcLo'Wu dtfplfl 

U n r I Ri Da.4ic O 


MFI) 4 * 


F(4 Dinecfor 


^ nf ^ fi E i9 & ^ tr?Sr ^ ^ ^ ^ 

55 S 5 C SC. ^ r§ S ^ C'Jt*c^ r* ^ 


u u 


u&x fV'Il''I ^ I. 

4 ^ 4 f Paired ?u.os v/lHt O^ b’isplo^ 


Ume pfiti4TE«^ Mftuudcnortxrts 


Figure H-5. Caution Advisors'- Task Response Times for Pilot 6 



'CABLE H- 6. AtTALYSIS OF VARIANCE FOR CAUTION ADVISORY RESPONSE TIMES BY PILOT 1 


w 

I' ■ : 

O 

% 

S'! 

DISPLAY: 

Run Number, R 
Number of Samples, n 
Mean, mj (sec) 

Standard Deviation, sj (sec) 
Standard Error, s^/^/n (sec) 

= 

Hsr 

(Corrected 

skewness) 

MFD 

MFD 

955^ FIDUCIAL INTERVALS FOR THE DIFFERENCE 
.BE!P//EEN !.EAN3 RASED ON BEHREN* S TEST 

DISPLAY HAVING LESSER MEAN 
RESPONSE TEffl AND FLIGHT 
PLAN NU?.IBER 

98 

12 

10.0 

22.1 

6.38 

2.13 1 
for 

99 

11 

3.1 

3.Jf 

1.0 

138 

11 

3.3 

2.8 

0.84 

^ = 6.9 

^.05 “ i 4.07 (Behren*s 
1^,05 ^ 14.03 (Scheffe) 

D^q^ = T4.22 (Cochran 
and Cox) 

m^g - m^38 ~ ^-5 
) D^05 = 1^-01 
d.05 = 15.99 
D 05 ^ 14.16 

) V.;/ 

2 

MFD 



*■ D - D . 1 1 V-°6Dren ' s 


Same as above 

li^2 


139 


°^i42 ” *”139 " 


2 



12 


12 


D .05 = 1.55 


Neither 



2.8 


2.H 







1.8 


1-7 







0.52 


0.1*9 






Seme as above 

151 


150' 


"‘150 “ “151 ^ 


s 
' — 
ITk 



20 


21 


d_o5=1.5i 


Neither 

K 


2.3 


2.9 





1 . 


0.8 


3.2 





-Pr" '• ■ 


o.i6 


0.70 






Same as above 

153 


152 




3 



21 


21 




Neither 





2.5 







1 .8 


1.0 






Same as above 

212 


211 


®212 “ *°211> 


4-1X 



30 


51 




Neither 



^.3 


V.1 







6.8 


6.8 






Same as above 

215 

223 

222 


®213 “ “222 “ 5.0 

CI 222 — ®*223 ~ 

4-lXFD 



51 

30 

30 


d.05 = 11-6 

0.05 = 3.22 

HSI 



7.5 

1.9 

4,5 



0,25 =1.87 




i8.9 

0.5 

8.8 







5.57 

0.091 

1.6 







1.86 


0 ,53 ( Corrected 








for skewness) 


V°.05 " 



*Difference between means significant at Q ,05 level after correction for skewness . 


MB 


£3 


TABLE H-T . ANALYSIS OF VAKIANCE FOR CAUTION ADVISORY RESPONSE TIMES BY PILOT 5 


75?t JWD S>^ FIDUCIAL IHTERVALS 
FOR THE DIFFERENCES BETWEEN 
MEANS BASED ON BEHREN’ S TEST 


DISPLAY HAVING LESSER MEAN 
RESPONSE TUffi AND FLIGHT 
PLAN mj.SSR 


Display 
Run Number, R 
Number of Samples, n 
Mean, mj 

Standai'd Deviation, aj 
Standard Error, a j/ 


4,1 

4.7 

1.05 

0.34 (Corrected 
for skewneas) 


«132-»153 
D q 5 - 7.07 



FD 

FD 


MFD 

H9I 

‘l47 “ “l46 “ 

144 

l45 

^05 * 2.34 

21 

21 

‘.25 * 1-55 

2.0 

1.9 


1.4 

1.3 


•via - "ilvS = 0-' 

Neither 


4 FD 
Neither 


Neither 

3 

MFD 


-D m - 1.28 


“172 “ ®173 * 


3-1X FD 
Neither 


R 

177 

W 

174 

“177 ~ “175 = ’•'* 

“175 ~ “174 = ^-5 


20 

21 

21 

0.05 - 2.1*0 

D.05 - 0.99 

“J 

3.5 

2.1 

1.6 

D_e5 = 1.39- 



^•8 

2.1 

0.5 



sj/s/n 

1.07 

0.46 

0.11 



/^/n -r 5 = 

0.35 (Corrected 






for skevness) 






®2li2 “ “244 
Neither 


“245 “ “246 =* 
Neither 


“248 “ 0^47 

Neither 


Difference between ffieana significant at 0.05 level after correction for skewness 
Line printer onitted this digit j therefore# underlined digit is uncertain. 








TABLE H -8 


ANALYSIS OF VARIANCE FOR CAUTION ADVISORY RESPONSE TIMES BY PILOT k 


95^5 FIDUCIAL INTERVALS FOR 
THE DIFFERENCE BETOffiffll 
MEANS BASED ON BEimEN^S TEST 


DISIM HAVING lESSER MEAN 

RESPONSE th® and plight 

PLAN NUI^TBER 


Display- 
Run Number, R 
Number of Sandies, n 
Mean, mj 

Standard Deviation, 
Standard Error, s^/ ^ 


“82 - “^0 = 5.6 


Neither 


HSI 

HSI 

MFD 

MFD 



R 84 

36 

88 

89 


1 xscc 

n 15 

14 

14 

15 


Neither 

cq 

9 .h 

3.6 

5.3 


(2 pair) 

Sj 0 . 4 , 

15.4 

3.5 

10.3 




HSI 

MFD 




R 

90 

91 


nigi - 0190 - 2.1 

1 

■ ■ '■■n,' 

16 

15 



Neither 

“a 

4.4 

6.5 





5.7 

14.3 




R 

106 

105 


®io 6 “ ®io5 “ 

2 FD 

■■■ n ' 

15 

11 


D_ 05 = 2.06 

Neither 

“3 : 

3.2 

2.2 





5.0 

1.5 




Vv^ 

0.83 

0.45 




s./yn -r 3 = 

0,28 (Corrected 



•D r\^ = 1.15 



for sRewiiess) 





:R: '■ 

164 

163 


®164 ~ ®163 - 

. . ■ 2 - 

; n 

• 13 ; 

14 


®.05 > ^ • ‘'5 

Neither 

: : : 

72.4 \ 

: 1 . 8 ; 





2.3';;:' 

0.6 





0.64 

0.16 
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TABLE H-8 (Concluded) 


I 


Vi 


Display 
Run Number, R 


HSI 

185 


MFD 

184 


AND soil FIDUCIAl INTERVALS 
FOR THE DIFFERENCE BETVffiEI'I 
MEANS BASED ON BEHREN'S TEST 


®185 “ "'184 = 2.7 


DISPLAY HAVING LESSER 
MEAN RESPONSE TBIE 
AND FLIGHT PLAN NDl-IBER 


3 - 1 X 


Number of Samples, n 

20 


20 

D,o 5 = 

3.94 , 

MFD 

Mean, my 

5,0 


2,3 

D ,25 = 

2.27 


Standard Deviation, Sj 

8,0 


2.5 




Standard Error, s^/\/n 

1,79 


0.56 




Sj/Vn-i -5 = 

0.60 (Corrected 



1,69 


for 

skewness ) 


^.05 “ 


R 

195 


196 

“ 195 “ 

“196 = 2-1 

4 - IX FD 

n 

40 


53 

^,05 " 

4.74 

Neither 

■ “j 

6,5 


4.4 





15.6 


4.9 




Sj/VH 

2.15 


0.85 




R 

197 


198 

“197 ~ 

“198 = V-®* 

4 -lX 

'n"' 

31 


30 

■^.05 = 

2.89 

MFD 

mj 

5.1 


3.3 

®,25 = 

1.68 



7.0 


3.5 




Sj/yH 

1 .26 


0,64 




sj/s/n 3 

0,42 (Corrected 


■ T\ _ — 

1.57 


for 

skewness) 


—^^,05 “ 


R 

253 


254 

“253 " 

m25l^ = 0,7 

5 - 1 XFD 

n 

21 


20 



. Neither 


3.1 


2.4 





5.0 


2.6 





256 


260 

“260 “ 

“256 = 1.8 

2 xscc 

n 

13 


13 

l >,05 = 

4.42 7 ;' 

Neither 


1.6 


3.4 




>3 

0,6 


7.3 




S3/V3 

0.17 


2,02 





'Difference between inearls significant at 0,05 level after correction for skewness, 
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TABLE H-9 


ANALYSIS OP VARIANCE FOR CAUTION ADVISOEY RESPONSE TIMES FOR PILOT 5 

DISH.AY HAVING LESSER 

75^ AND 95^0 FIDUCIAL INTERVALS MEAN RESPONSE Tn*lE 





FOR THE DIFFERENCE BETWEEN 

AND 




MEANS BASED ON BEHREH'S TEST 

FLIGHT PLAN TOIBER 

Display 

HSI 

MFD 



Run Number^ R 

75 

76 

mrj^ — = 0.5 

1 FD 

Number of Samples, n 

14 

l4 

D,o5 = 0.88 

MFD 

Mean, 

2.5 

1.8 

D.25 = 0.5 


Standard Deviation, Sj 

1.^ 

0.6 



Standard Error, sj/ 

0.3,7 

0.16 



sj/v^ ^ 3 

0\ 12 (Corrected 


— — ^.05 “ 0 ,44 



for skewness) 




R 

78 

77 

“77-“^8 = °*5 

1 

n 

15 

16 

73° l).o5 = 1.35 

Neither 


1.9 

2.4 




0.7 

2.4 



Sj/yn 

0,18 

0.6 




HSI 

MFD 

MPD 


R 

105 

101 

100 

2 PD 

n 

13 

13 

12 

Neither 

>“o 

k.6 

3.2 

10.2 



5.2 

5.2 

55.4 


R 

iai 

125 

“123 - “121 = • 

2 

n 

13 

12 

D.05 = 9.77 

Neither 


4.5 

9.2/ 

d,33 = 4.72 


n 

5.9 

14.5 



sj/yn 

1.64 

4.19 



R 

125 

124 

"Couldn' t do task in turns" 

2 XSCC 

n 

7 

6 


Neither 

“d 

64.9 

100.7 




81.5 

187.2 



sj/y° 

30.8 

76.4 



R 

126 

127 

“127 “126 “ 3.4 

2 FD 

n 

12 

13 

: : ®.o5 = 5:»23 ; : 

HSI 

. : “L 

3.0 

6.4 

d .25 = 2.98 


' 

2.k 

8.3 



sj/ys 

0.69 

2.3 



sj/yn -f 5 

( Corrected 

0.77 - 

—D = 2.24 



for skewness) 


•05 



*Dlfference between means significant at 0.05 level after correctioh for skewness. 


TR-1072-1 


TABLE H-10 


analysis of variance for caution advisory response times for pilot 6 

DISPLAY HAVING LESSER 





75*. 

90 * AND 95* FIDUCIAL INTERVALS 

MEAN RESPONSE THAE 




FOR THE DIFPERE^ICE BEa>7EEN MEANS 

AND 





BASED ON BEHREN* S TEST 

FLIGHT PLAN NUMBER 

Display 

HSI 

MFD 




Run Number, R 

192 

191 


®192 *** ®191 ~ 3»o*t 

4-IXFD 

Number of Samples, n 

30 

31 


D.05 = 5.98 

MFD 

Mean, m j 

6A 

3.4 


>25 = 2.31 


Standard Deviation, sj 

10.1 

3.4 




Standard Error, sj/ yS 

1.84 

0.61 




R 

203 

204 


* t 

^05 * ®204 = 2,2 

3“1X fd 

n 

21 

20 


d.05 

MFD 


5 . 0 * 

2.8 


D 25 = 1.61 



5*7 

2.0^ 





1.24 

0.45 





HSI 

MFD 


^207 "" ^16 6.1*^ 


R 

207 

214 

218 

4-lX 

n 

41 

16 

31 

84° d.05 = 

MFD 

“d 

8.3 

1.8 

2,2 

*D.io = 5.22 



19 V 

1.1 

1.7 



Bj/Jn 

3.11 


0.51 



R 

22lf 

225 


“225 - “224 = ■'•0*' 

3 - 1 X 

n 

20 

20 


D ,05 ^ 1-57 

HSI 


1.9 

2.9 


*D.25 = 0.91 



1.0 

3.2 




Sj/v^ 

0.22 

0.72 




R 

226 

227 


®227 “ ®226 ~ ^ ' 5 

3-1XPD 

n 

20 

20 



Neither 


2.1 

2.4 





2.0 

1.4 




R 

181 

180 

Pilot didn't attend to task closely 

3-lx^ 

n , 

<20 

<20 




' ■ 

36;1 

27.8 





62.1 

56.6 





Difference between means significant at 0.25 level. 

tDifference between means significant at 0^05 level after correction for skewness. 
^Difference between means significant at 0.1 level. 

^Line printer missed these characters) underlined digits are uncertain. 
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